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MANUFACTURING  FACT  FINDING 
GUIDE 


1.  Introduction 

Manufacturing  Fact  Finding  (FF)  is  one  of  the 
key  elements  of  hardware  production  contract 
proposal  evaluations.  It  is:a  critical  examina¬ 
tion  of  the  offeror’s  cost  (labor)  estimates  rela¬ 
tive  to  the  solicitation  and  the  proposed  manu¬ 
facturing  approaches  and  methods  which  cul¬ 
minates  in  a  Technical  Evaluation  Report.  The 
Technical  Evaluation  report  addresses  ithe 
quantitative  and  qualitative  aspects  of  the  pro¬ 
posed  direct  and  support  labor  estimates  and  is 
a  major  input  to,  and  often  the  cornerstone  for, 
contract  negotiations.  The  manufacturing  fact 
finding  Technical  Evaluation  Report  must 
therefore  stand  on  its  own  and  cite  reasons  for 
its  findings  sufficiently  compelling  to  prevail 
during  negotiations. 


1.1  Purpose 

The  purpose  of  this  document  is  to  delineate  a 
set  of  guidelines  for  fact  finding  production 
hardware  manufacturing  proposals  to  ensure 
fact  finding  is  properly,  rigorously  and  consis¬ 
tently  performed  by  BMO.  The  audience  tar¬ 
geted  by  this  document  are  those  individuals 
called  upon  to  fact  find  the  Manpower  Volume 
of  hardware  manufacturing  proposals.  For  the 
fact  finding  neophyte,  it  is  intended  as  a  primer 
and  guide  for  the  process.  For  the  fact  finding 
veteran,  it  is  intended  as  a  refresher  and  check 
list  of  the  fact  finding  proccss.<jltjs_noted  that, 
there  is  no  substitute  for  an  experienced  Fact'\ 
Finder — it  is  the  objective  of  this  guide  to  help 
the  new  Fact  Finders  quickly  gain  the  requisite 
experience. 


1.2  Scope 

This  guide  is  intended  for  the  evaluation  of  di¬ 
rect  and  support  labor  estimates  and  is  therefore 
limited  to  fact  finding  the  Manpower  Volume  of 
proposals  for  hardware  production  contracts. 
It  is  not  applicable  to  fact  finding  of  other  vol¬ 
umes  (i.e..  Cost,  Technical  and  Management) 
or  proposal  submitted  for  full  scale  develop¬ 
ment  or  other  type  contracts. 


1.3  Background 

The  following  paragraphs  briefly  provide 
background  regarding  Manufacturing  Fact 
Finding  as  related  to  BMO.  It  is  formatted  as  a 
series  of  questions  and  answers  and  is  intended 
for  the  fact  finding  neophyte. 

What  Authorizes  Fact  Finding?  Fact 
finding  is  authorized  by  the  Federal  Acquisition 
Regulations  and  implemented  by  Air  Force 
Regulation  (AFR)  75-15,  Source  Selection 
Policy  and  Procedures  and  the  Request  for 
Proposal  (RFP). 

Why  Fact  Find?  Fact  finding  is  integral  to 
the  progression  of  the  Air  Force  procurement 
process.  Fact  finding  is  conducted  to  deter¬ 
mine  whether  the  offerer's  proposed  costs  are 
realistic  in  relation  to  the  solicitation  (the  RFP) 
and  the  technical  proposal,  and  to  provide  an 
assessment  of  the  reasonableness  of  the  pro¬ 
posed  cost.  If  the  proposal  cost  is  deemed 
totally  unreasonable  and/or  unfounded,  an 
independent  recommendation  of  what  the  con¬ 
tract  should  cost  should  be  prepared  and  will 
serve  as  the  basis  of  contract  negotiations  with 
the  offeror. 

What  Triggers  Start  of  Fact  Finding? 
Who  Decides  What  Requires  Fact 
Finding  and  Why?  Formal  fact  finding  is 
initiated  by  receipt  of  the  proposal  which  is 
immediately  subjected  to  a  quick  review  to 
determine  if  it  is  responsive  to,  and  contains  all 
the  information  specified  by,  the  RFP.  This 
determination  is  made  by  BMO  (the  project 
officer  with  assistance  of  a  Contract  Price 
Analyst)  with  support  from  BMD  if  requested. 
If  the  proposal  is  deemed  deficient,  the  project 
officer,  the  Contract  Price  Analyst,  and  the 
contracting  officer  immediately  request  reme¬ 
dial  submittals,  usually  the  missing  data.  If  the 
requested  data  is  not  furnished,  the  proposal  is 
rejected.  If  the  proposal  is  deemed  acceptable, 
fact  finding  proceeds  according  to  an  evaluation 
plan  developed  by  the  project  officer  and  the 
Contract  Price  Analyst  with  inputs  from 
members  of  the  fact  finding  team.  Ibis  evalua¬ 
tion  plan  is  prepared  following  the  quick 
review  of  the  proposal  and  establishes  review 
responsibilities  and  schedule  milestones.  The 
evaluation  plan  identifies,  based  on  the  quick 
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review  of  the  proposal,  areas  to  be  given 
special  attention  or  treatment  These  special 
areas  may  be  driven  by  a  number  of  considera¬ 
tions  such  as  technical/schedule  risk,  use  of 
new  technologies/manufacturing  processes, 
unusual  procurement  requirements,  non- 
continuous  production,  or  any  other  special 
circumstances. 

Who  Assigns  Personnel  to  Fact 
Finding?  Generally,  the  project  officer 
assembles  and  directs  the  efforts  of  the  fact 
finding  team.  The  project  officer  is  assisted  by 
a  Contract  Price  Analyst  The  composition  of 
the  fact  finding  team  varies  to  suit  the  nature  of 
the  proposal  being  evaluated  and  is  composed 
of  both  technical  and  non-technical  specialists 
as  required  to  ensure  a  comprehensive  evalua¬ 
tion.  Fact  finders  are  usually  drawn  from 
BMG/BMD;  however  when  specialties  not 
organic  to  BMO/BMD  are  required,  resources 
from  other  government  agencies  may  be 
employed. 

What  is  the  Procedure  for  Acquiring 
the  Information  Necessary  to  Perform 
Fact  Finding?  The  primary  source  of  infor¬ 
mation  is  the  offeror’s  proposal.  The  offerors 
are  directed  to  prepare  and  submit  a  proposal  in 
accordance  with  a  set  of  Proposal  Preparation 
Instructions  (PPI)  which  is  integral  to  the 
solicitation.  (A  typical  PPI  is  shown  in 
APPENDIX  II)  Hie  fact  finding  team  reviews 
the  proposal  to  glean  the  information  required 
to  make  the  necessary  assessments.  Where 
aspects  of  the  proposal  require  clarification,  or 
data  provided  is  inadequate,  or  contradictory. 
Requests  for  Information  (RFIs)  are  issued  to 
the  offeror.  These  RFIs  are  submitted  and 
processed  formally  through  the  contracting  of¬ 
ficer  or  informally  through  verbal  communica¬ 
tions.  Informal  queries  and  responses  thereto 
ate  documented  for  the  recoid. 

What  are  the  Steps  to  be  Performed  in 
Fact  Finding?  The  fact  finding  methodol¬ 
ogy  is  described  in  section  4  of  this  guide.  It  is 
a  process  which  entails  extracting  and  evaluat¬ 
ing  data  from  the  proposal.  If  tire  data  is  not 
available  in  the  proposal,  the  data  is  obtained 
via  RFIs  (formally)  or  verbally  (informally) 
from  the  offeror.  Hie  objective  is  to  evaluate 
the  proposed  effort  and  cost  for  reasonableness 
against  the  solicitation  in  relation  to  the  of¬ 


feror-s  manufacturing  and  management  ap¬ 
proach.  This  data  is  also  evaluated  against  me 
offeror’s  past  performances  on  similar  or 
related  manufacturing  efforts  when  possible. 
Integral  to  every  proposal  is  the  justification  of 
the  offerors  estimates.  A  key  element  of  fact 
finding  ir>  the  review  and  evaluation  of  these 
justifications.  I?  the  justifications  are  valid, 
estimates  are  accepted.  If  not,  the  estimates  are 
rejected  and  the  offeror  asked  to  justify  and/or 
revise  the  estimates.  All  rejected  parts  of  the 
proposal  or  estimates  must  be  for  sound 
reasons  which  stand  on  their  own  merit  and  are 
sufficiently  compelling  to  prevail  during  nego¬ 
tiations.  On  occasions,  it  may  be  determined 
that  the  contractor  underestimated  the  effort 
required  and  additional  hours  in  some  areas 
may  be  recommended. 

'What  is  the  Expected  Outcome  of  Fact 
Finding?  The  fundamental  product  of  fact 
finding  is  the  Technical  Evaluation  Report 
which  is  used  by  the  government  in  negotiating 
with  the  offeror.  At  minimum,  the  Technical 
Evaluation  Report  includes: 

1.  A  developed  minimum  and  maxi¬ 
mum  (probable)  position  for  use  in 
negotiations,  and 

2.  Identification  of  areas  to  be  negoti¬ 
ated  with  documentation  of  the  ba¬ 
sis  for  any  recommended  changes. 

Preparation  guidelines  for  the  Technical 
Evaluations  Report  are  included  in  Section  4  of 
this  guide. 

What  Feedback  is  Required  to  Verify 
Effectiveness  of  Fact  Finding  and  to 
Verify/Update  Factors  Used?  Currently 
at  BMO,  a  formal  library  documenting  past  fact 
finding  efforts  is  not  maintained.  However, 
"personaP'  libraries  are  maintained  by  individ¬ 
ual  fact  finders.  These  personal  libraries  often 
contain  data  on  an  offeror’s  past  performance 
and  provide  insight  into  his  capabilities  and 
characteristics.  To  facilitate  fact  finding  and  to 
improve  the  efficiency/effectiveness  of  the 
process,  fact  finders  si  lid  access  these 
"libraries."  In  fact,  a  form*-  fact  finding  library 
should  be  created  and  maintained  on  all 
manufacturing  proposals  evaluated.  And  all 
fact  finders  should  contribute  to  and  maintain 
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this  library.  Separate  data  bases  should  be  kept 
for  each  different  contractor.  Feedback  from 
the  contract  negotiations  is  vital  for  this  library 
and  should  be  solicited  from  the  negotiators 
following  completion  of  negotiations  to 
maintain  currency  and  relevancy  of  the  library, 
and  to  help  fact  finders  in  assessing  the  impacts 
of  their  findings  and  the  effectiveness  of  their 
arguments  and  presentation  style.  Following 
each  proposal  fact  finding  effort,  the  factors 
used  to  develop  the  independent  cost  estimates 
should  be  recorded.  This  library  will  greatly 
facilitate  evaluation  of  ftiture  proposals  and 
provide  bases  for  the  fact  finders  to  argue  and 
justify  findings.  It  will  also  provide  data  points 
on  the  offeror  regarding  his  performance  im¬ 
provement  propensity.  The  offeror's  support 
labor  performance  should  also  be  recorded  for 
future  reference  and  to  track  performance 
changes.  • 

2 .  Applicable  Documents 

AF  Regulation  75-15 

Contracting  and  Acquisition  Source 

Selection  Policy  and  Procedures 

February  1984 

BMOED82-3 

Engineering  Directive  for  Technical 

Evaluation  Reports 

10  June  1982 

MIL-STD-1567A 
.  Work  Measurement 

11  March  1983 

DoD  5010.15. 1-M 

Standardization  of  Work  Measurement 

September  1973 

3 .  Terms  Defined 

This  section  defines  the  key  parameters  and 
terms  commonly  used  in  manufacturing  fact 
finding  as  conducted  by  BMO. 

Standard/Standard  Time.  The  time  which 
is  determined  to  be  necessary  for  a  qualified 
worker,  working  at  a  pace  which  is  ordinarily 
used  under  capable  supervision  and  experienc¬ 
ing  normal  fatigue  and  delays,  to  do  a  defined 
amount  of  work  of  specified  quality  when 
following  the  prescribed  method.  Fact  finders 


at  BMO  interchangeably  use  the  terms 
Standard  and  Standard  Time. 

Touch  (Direct)  Labor.  Labor  which  alters 
the  composition,  condition,  configuration,  or 
construction  of  the  product;  the  cost  of  which 
can  be  identified  with  and  assessed  against  a 
particular  part,  product,  or  group  of  parts  or 
products  accurately  and  without  undue  effort 
and  expense.  It  is  production  labor  which  can 
be  reasonably  and  consistently  related  directly 
to  a  unit  of  work  being  assembled,  fabricated, 
or  inspected.  It  involves  work  affecting  the 
composition,  condition,  or  production  of  a  pro¬ 
duct.  It  includes  such  functions  as  machining, 
welding,  fabricating,  setup,  cleaning,  painting, 
assembling,  and  on-line  inspection  or  test  of 
production  articles.  It  also  includes  the  labor 
required  to  complete  the  manually-controlled 
process  portion  of  the  automated  work  cycles. 

Standard  Time  Data  is  a  compilation  of  all 
elements  that  are  used  for  performing  a  given 
class  of  work  with  normal  elemental  time 
values  for  each  element.  The  data  are  used  as  a 
basis  for  determining  the  Touch  Labor 
Standard  Time  on  work  similar  to  that  from 
which  the  data  were  determined. 

Normal  Time  is  the  time  required  by  a  quali¬ 
fied  worker,  to  perform  a  task  at  a  normal  pace, 
to  complete  an  element,  cycle  or  operation, 
using  a  prescribed  method.  For  manpower 
estimates  contained  in  proposals  submitted  to 
BMO,  Normal  Time  should  be  based  on  Type 
I  Engineered  and  Type  II  Touch  Labor 
Standards.  The  personal,  fatigue  and 
unavoidable  delay  (PF&D)  allowance  added  to 
this  normal  time  results  in  the  Standard 
Time. 

Standard  Time  =  Normal  Time  +  PF&D 

The  Touch  Labor  standards  are  the  foundation 
of  the  work  measurement  system.  They  re¬ 
present  the  baseline  from  which  performance  is 
measured.  Consequently,  these  labor  stan¬ 
dards  do  not  contain  elements  of  "inefficiency", 
"realization",  or  "variances".  It  is  to  be  noted 
that  labor  standards  are  often  modified  by 
"realization  factors"  (or  other  inefficiency 
factors)  for  purposes  of  planning,  budgeting, 
scheduling,  or  estimating.  However,  only  un¬ 
modified  labor  standards  are  used  to  deter-mine 
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normal  time  associated  with  any  production 
element,  cycle  or.operation. 

Support  (Indirect)  Labor.  Work  which 
is  performed  rendering  services  necessary  to 
production,  the  cost  of  which  cannot  be 
assessed  against  any  part,  product,  or  group 
of  parts  or  products  accurately  without  undue 
effort  and  expense.  It  includes  the  labor  re¬ 
quired  to  support  the  operators  performing 
Touch  Labor  operations.  For  BMO  con¬ 
tracts,  the  recognized  manufacturing  support 
labor  functions  are: 

Shop  Supervision 

Manufacturing/Production  Management 

Production  Control  and  Planning 

Procurement/Materiel 

Manufacturing  Engineering 

Industrial  Engineering 

Test  Equipment  and  Tooling  Maintenance 

It  is  to  be  noted  that  not  all  of  the  functions 
listed  are  applicable  to  all  manufacturing 
contracts  and  there  could  be  other  functions  not 
listed  which  may  need  to  be  included  and  eval¬ 
uated.  The  categories  included  in  each  pro¬ 
posal  are  a  matter  of  contractor  policy  and 
style. 

Personal,  Fatigue  and  Delays  (PF  &  D) 
PF  &  D  consists  of  the  following  allowances: 

Personal  Allowance  is  a  time  value 
or  percentage  of  time  by  which  normal 
time  is  increased  to  allow  for  personal 
needs  (for  example,  getting  a  drink  of 
water,  washing  hands,  going  to  the  rest 
room). 

Fatigue  Allowance  is  a  time  value  or 
percent-age  of  time  by  which  normal 
tune  is  increased  to  allow  for  a  decrease 
in  an  operator's  capacity  to  produce  due 
to  physical  or  mental  fatigue. 

Unavoidable  Delay  Allowance  is  a 
time  value  or  percentage  of  time  by 
which  normal  time  is  increased  to  allow 
for  unavoidable  minor  delays  beyond 
the  control  of  the  operator.  Other  ir¬ 
regularly  occurring  or  major  delays  are 
normally  not  absorbed  by  this  supple¬ 
mental  allowance,  but  are  charged  in 


accordance  with  the  offeror's  overhead 
charging  practices. 

Type  I  Engineered  Labor  Standards  are 
standards  established  using  a  recognized  tech¬ 
nique  such  as  time  study,  standard  data,  a 
recognized  predetermined  time  system  or  a 
combination  thereof.  The  untailored  MIL-STD 
-1567A  requires  80%  of  the  Touch  Labor 
associated  with  a  labor  effort  to  be  covered  by 
the  Type  I  standards.  All  major  contractors 
per-forming  manufacturing  work  for  the  DoD 
are  required  to  establish  and  maintain  Type  I 
Engineered  Labor  Standards. 

Type  II  Labor  Standards  are  the  Touch 
Labor  Standards  that  predict  the  time  an 
element  or  operation  should  take  based  on  the 
best  information  that  is  available.  This  includes 
all  labor  not  covered  by  Type  I  Engineered 
Labor  Standards. 

Performance  Improvement  (PI)  Curve  is 
a  quantitative  technique  used  to  predict  resource 
requirements  in  a  manufacturing  operation.  It 
is  based  on  historical  observations  that 
individuals  performing  repetitive  tasks  exhibit 
an  improvement  in  performance  as  the  task  is 
repeated.  Empirical  studies  of  this  phe¬ 
nomenon  results  in  three  conclusions  which 
serve  as  the  foundation  of  the  current  theory 
and  practice: 

•  The  time  (touch  labor  hours)  re¬ 
quired  to  perform  a  task  reduces  as 
the  task  is  repeated. 

•  The  amount  of  improvement  de¬ 
creases  as  more  units  are  produced. 

•  The  rate  of  improvement  has  suffi¬ 
cient  consistency  to  allow  its  use  as 
a  predictive  tool. 

Figure  1  typically  illustrates  the  PI  curve  which 
when  plotted  on  log-log  coordinates,  is  a 
straight  line.  The  PI  curve  is  discussed  in  more 
detail  in  Section  4  and  APPENDIX  I  of  this 
guide. 


4 


FIGURE  1  TYPICAL  PI  CURVE  EXAMPLE 


Slope  Factor.  This  parameter  is  the  slope 
constant  of  the  performance  improvement 
curve.  It  is  a  percentage  figure  that  represents 
the  steepness  of  the  curve.  It  is  also  called 
"the  slope  of  the  curve."  It  is  a  percentage  fig¬ 
ure  that  represents  the  steepness  of  the  curve. 
This  percentage  is  represented  by  the  value  (in 
hours  or  cost)  at  a  doubled  production  quantity 
relative  to  the  previous  quantity.  For  example, 
with  a  rate  of  improvement  of  90  percent,  the 
unit  cost  of  the  8th  unit  is  90  percent  of  the  cost 
of  the  4th  unit;  the  unit  cost  of  the  100th  unit  is 
90  percent  of  the  cost  of  the  50th  item,  and  so 
forth.  It  is  further  described  in  APPENDIX  I. 

T1  or  First  Unit  Cost  is  the  theoretical  cost 
(measured  in  labor  hours)  of  the  first  produc¬ 
tion  unit  This  item  is  usually  determined  as  a 
product  of  the  development  of  the  performance 
improvement  curve. 

T1000  is  the  cost  (measured  in  labor  hours)  of 
the  thousandth  unit  produced.  Typically,  for 
fact  finding,  it  is  the  estimated  cost  at  a  point  in 
the  production  run  at  which  the  variances 


(non- work)  have  been  diminished  to  suffi¬ 
ciently  low  levels  that  "steady  state"  production 
is  assumed  achieved.  It  is  the  point  at  which 
performance  improvements  achieved  by  the 
manufacturer  have  progressed  such  that  the 
actual  touch  labor  cost  (hours)  less  the  allowed 
variances  is  equal  to  the  Standard  Time. 
T1000  is  therefore  the  Standard  Time 
modified  by  the  Realization  Factor.  BMO, 
as  a  general  rule,  uses  this  parameter  (and  the 
slope  factor)  to  establish  the  performance 
improvement  curve. 

True  Midpoint  (TMP)  is  an  artifact  used 
with  the  PI  curve  to  determine  the  cost  of  a 
production  lot.  It  is  the  number  of  production 
unit  which  represents  the  average  unit  cost  of  a 
production  lot.  It  is  determined  by  the 
equation: 

TMP  =  [{N  x  (1  +  b)}/{(L  +  0.5)  ^  - 
(F  -  0.5)  l+b)]-l/b 
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where: 

N  =  Number  of  units  in  the  production  lot 

F  =  Production  unit  number  of  the  first 
unit  in  the  lot 

L=  Production  unit  number  of  the  last 
unit  in  the  lot 

b  =  Slope  factor  of  the  performance  im¬ 
provement  curve  (see  APPENDIX  I) 

Realization  Factor  is  defined  by  the 
equation: 

Realization  Factor  =  Touch  Labor  Hours 

/Standard  Time 

Where  the  numerator  is  the  Touch  Labor 
Hours,  including  the  allowable  variances 
(non-work),  associated  with  tasks  represented 
by  the  Standard  Time  in  the  denominator. 
ITie  Realization  Factor  is  the  ratio  of  the 
actual  Touch  Labor  Hours  required  to  gen¬ 
erate  a  given  unit  of  work  compared  to  the 
corresponding  Standard  Time.  Numerically, 
it  is  always  greater  than  1.  It  is  a  measure  of 
overall  performance  (shop,  product  line,  plant) 
and  is  used  by  offerors  in  their  cost  estimates. 
For  BMO  production  contracts,  the  generally 
recognized  variances  of  touch  labor  from  the 
standard  time  stem  from  four  elements:  Re¬ 
work,  Operator  Inefficiency,  Shop 
Inefficiency,  and  Engineering  Changes  (see 
definitions  below). 

The  Realization  Factor  is  a  key  item  of  the 
offeror’s  cost  estimates  and  is  subjected  to 
considerable  scrutiny  during  fact  finding.  The 
variance  elements  of  this  factor  should 
therefore  be  fully  described  and  quantified  and 
justified  in  sufficient  detail  by  the  offeror  to 
permit  detail  assessment  by  the  fact  finders. 

Variance.  The  difference  between  any  stan¬ 
dard  or  expected  value  and  an  actual  value.  In 
the  current  context,  variances  are  the  non-work 
by  which  costs  (in  hours)  depart  from  the  real 
work  (Standard  Time)  required  to  perform  a 
manufacturing  operation.  There  are  four  major 
categories  of  variances. 


Rework:  Departures  from  the  stan¬ 
dards  caused  by  any  corrections  of  de¬ 
fective  work  either  before,  during,  or 
after  inspection. 

Operator  Inefficiency;  Departures  from 
the  standards  attributable  to  personnel 
turnover,  absenteeism,  idle  time,  etc. 

Shop  Inefficiencies:  Departures  from 
the  standards  due  to  short  term  delays 
because  of  material  shortages,  faulty 
and  broken  tools,  defective  material, 
etc. 

Engineering  Changes:  Departures  from 
the  standards  caused  by  engineering 
changes  after  start  of  production. 

Scrap.  Residual  material  resulting  from  ma¬ 
chining  or  assembly  processes,  such  as  ma¬ 
chine  shavings,  unusable  lengths  of  wire, 
faulty  parts,  etc. 
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4.0  The  Fact  Finding  Methodology 

Typically,  Manufacturing  Fact  Finding  (FF) 
encompasses  two  principle  efforts;  (1)  assimi¬ 
lation  of  the  offeror's  proposal  and  cost  esti¬ 
mates  followed  by  (2)  a  technical  evaluation  of 
his  estimates.  Assimilation  of  the  proposal  in¬ 
volves  extracting  data  from  the  offeror's  pro¬ 
posal  and  related  submittals  supplemented  by 
interchanges  with  the  offeror  at  FF  meetings 
and  through  verbal  (informal)  or  written 
(formal)  Requests  for  Information  (RFIs). 
Technical  evaluation  involves  dissecting,  sort¬ 
ing,  and  evaluating  the  touch  and  support  labor 
hours  proposed  at  the  component  and  various 
ascending  levels  of  assembly  such  as  sub- 
assemblies,  subsystems,  and  WBS  elements  to 
assess  reasonableness  of  the  estimates. 

4.1  Phases  of  Fact  Finding 

Figure  2  graphically  illustrates  the  FF  method¬ 
ology  as  typically  conducted  by  BMO.  For 
convenience  in  this  discussion,  the  methodol¬ 
ogy  is  segmented  into  four  phases  as  shown: 
I.  Pre-Fact  Finding;  n.  Preparation  for  Fact 
Finding  Meeting;  HI.  Fact  Finding  Meeting; 
and  IV.  Technical  Evaluation.  The  phases 
often  overlap  and  execution  of  FF  tasks  entirely 
within  phases  is  not  crucial  nor  mandatory. 
There  will  be  occasions  where  it  will  be  neces¬ 
sary  and  prudent  to  depart  from  this  methodol¬ 
ogy  in  response  to  special  needs  and  condi¬ 
tions.  Each  of  the  phases  is  described  in  the 
following. 

4.2  Pre-Fact  Finding  (Phase  I) 

This  phase  generally  consists  of  efforts  ex¬ 
pended  in  preparation  for  fact  finding  such  as 
familiarizing  the  fact  finders  with  the  procure¬ 
ment  and  background  on  the  potential  of- 
feror(s).  It  often  includes  supporting  the  de¬ 
velopment  of  the  Proposal  Preparation 
Instructions  (PPI)  of  the  Request  for  Proposal 
(RFP).  The  PPI  specifies  how  the  proposal 
submittals  and  cost  estimates  are  to  be  pre¬ 
pared.  Typically,  a  well  prepared  PPI  con¬ 
cisely  and  completely  specifies  the  data  re¬ 
quired  for  FF  (estimated  touch  and  support 
labor  hours  and  associated  costs  with  justifica¬ 
tions)  in  a  form  and  format  unambiguously 
traceable  to  WBS  elements,  sub-systems, 
assemblies,  and  components. 


A  well  prepared  PPI  will  significantly  reduce 
the  FF  team's  burden  of  extracting,  interpret¬ 
ing,  and  evaluating  data  submitted  with  the 
proposal.  It  is  therefore  desirable  to  have  a 
well  prepared  PPI  in  the  RFP  and  important  to 
diligently  support  preparation  of  the  RFP.  It  is 
to  be  noted  that  the  PPI  should  not  require  data 
the  offeror  is  not  normally  expected  to  generate 
in  his  response  to  the  RFP.  The  PPI  should 
merely  direct  the  offeror  to  provide  specific 
sorts  of  his  data  to  provide  insight/information 
regarding  the  cost  structure  and  make-up  of  his 
proposal.  Besides  benefiting  the  FF  team,  well 
prepared  PPI  also  benefits  the  offeror  by: 

•  providing  insight  to  what  the  FF 
team  will  be  looking  for  and  evaluat¬ 
ing, 

•  unambiguously  directing  the  offeror 
how  to  break-down,  sort,  summarize 
and  present  his  labor  and  cost  esti¬ 
mates,  and 

•  allowing  the  offeror  to  critically  look 
at  his  proposal  from  the  FF  team's 
perspective  and  thus  providing  him 
an  opportunity  to  assess  reasonable¬ 
ness  prior  to  submittal 

Conversely,  a  poor  (loose)  PPI  usually  forecast 
difficult  FF  characterized  by: 

•  proposal  submittals  which  mus*  be 
carefully  and  tediously  examined  to 
isolate  and  extract  the  data  required, 

•  incomplete  submittals  which  do  not 
contain  ail  the  data  necessary  to  per¬ 
form  orderly  evaluations, 

•  considerable  investment  in  time  and 
effort  with  the  offeror  to  extract  the 
data  from  and  decipher  the  proposal, 

•  increased  subjectivity  in  the  evalua¬ 
tion  process,  and 

•  difficult  negotiations  and  potential 
erosion  of  BMO/offeror  relations. 

A  loose  PPI  should  therefore  be  avoided.  Fact 
finders,  when  given  the  opportunity,  should 
make  every  effort  to  influence  the  PPI  to  ensure 
that  the  cost  estimates  are  comprehensively 
prepared  and  presented  in  a  unambiguous  and 
easy  to  evaluate  fashion.  A  preferred  PPI 
(generic)  related  to  manufacturing  FF  is  con¬ 
tained  in  APPENDIX  n. 
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FIGURE  2.  FACT  FINDING  METHODOLOGY  (TYPICAL) 


4.3 

II) 


Preparation  for  FF  Meeting  (Phase 


Typically,  immediately  upon  receipt  of  the  pro¬ 
posal,  the  proposal  is  reviewed  by  the  project 
officer  and  Contract  Price  analyst  to  determine 
that  the  proposal  contains  all  information  re¬ 
quired  for  an  orderly  technical  and  cost  review. 
Members  of  the  FF  team  are  often  called  upon 
to  support  this  preliminary  review  to  determine 
what  additional  data  are  necessary,  and  the  need 
for  and  desired  depth  of  field  reviews  by 
AFPRO  or  DCASPRO.  The  end  result  of  this 
preliminary  review  will  be  a  plan  of  action 
which  will  establish  review  responsibilities  and 
schedule  milestones.  In  the  event  that  neces¬ 
sary  data  are  missing,  the  contracting  officer 
should  request  the  additional  information  im¬ 
mediately,  and  if  not  furnished,  reject  the  of¬ 
feror's  proposal. 

For  the  FF  team,  this  is  an  intensive  phase 
wherein  the  bulk  of  the  FF  effort  generally  oc¬ 
curs.  The  primary  activities  of  this  phase  are 
illustrated  in  Figure  2  and  consist  of  extracting, 
assimilating,  and  evaluating  the  labor  estimates 
from  the  proposal.  An  independent  preliminary 
analysis  of  the  data  is  made  in  this  phase.  This 
analysis  is  compared  to  the  proposed  hours  to 
identify  discrepancies,  FF  focus  areas,  and  to 
prepare  for  the  FF  meeting  (phase  IE)  with  the 
offeror.  These  results,  may  be  discussed  with 
other  members  of  the  fact  finding  team  for  pur¬ 
poses  of  cross-referencing  and  position 
assessment. 


analyze.  It  is  therefore  important  to  ascertain 
early  in  the  FF  process  the  adequacy  and 
completeness  of  the  offeror's  labor  estimates 
and  basis  of  estimates  and  prepare  remedial 
RFIs  as  appropriate. 

All  RFIs  should  be  coordinated  with  the  re¬ 
sponsible  BMO/AWM  officer.  It  is  also  pru¬ 
dent  to  denote  ''MANUFACTURING''  at  the 
top  of  each  RFI  because  RFIs  submitted  by 
other  FF  disciplines  will  be  submitted  and  in¬ 
termingled  with  the  manufacturing  RFIs. 

Typical  suggested  generic  RFIs  can  be  found  in 
APPENDIX  ffl. 

Tabulation  of  Data.  To  effectively  review 
and  extract  data  from  the  proposal,  the  fact 
finder  needs  to  determine  if,  and  how,  the 
manufactured  item  is  best  compartmented  to 
facilitate  evaluation.  Very  complex  items  are 
often  divided  into  manageable  pieces  generally 
consisting  of  subsystems  or  major  sub- 
assemblies.  Others  are  very  simple  and  com- 
partmenting  provides  little  additional  insight 
useful  to  the  evaluators.  This  compartmenting 
is  very  discretionary  and  a  function  of  the  ex¬ 
perience  of  the  fact  finder.  Generally,  the  fact 
finder  uses  a  level  of  compartmenting  he  is 
comfortable  with.  There  are  no  rules  for  com¬ 
partmenting  —  whatever  makes  sense  and 
eases  FF  can  be  used.  However,  it  is  to  be 
noted  (as  intuitively  obvious)  the  higher  the  de¬ 
gree  of  compartmenting,  the  better  the  cost 
resolution  and  easier  the  evaluation. 


4.3.1.  Data  Extraction.  This  phase  is  ini¬ 
tiated  by  a  general  review  of  tile  Proposal  and 
associated  Basis  of  Estimates  (BOEs)  to  de¬ 
termine  if  the  labor  hour  estimates  are  com¬ 
pletely  and  unambiguously  presented.  If  the 
proposal  is  grossly  deficient,  the  proposal  may 
be  rejected  by  the  project  officer  on  recommen¬ 
dation  of  the  fact  finders.  If  the  pro-posal  is 
only  deficient  in  a  few  items,  appropriate  RFIs 
should  be  immediately  written  and  submitted 
through  BMO  to  the  offeror  for  action.  To 
avoid  unacceptable  or  vague  responses,  the 
RFIs  should  be  prepared  unambiguously  with 
specific  information  requested  and  with 
formatting  and  structure  of  the  information 
specified  as  appropriate.  It  is  important  to  note 
that  the  ability  to  fact  find  essentially  mirrors 
the  quality  of  the  data  available  to  review  and 


The  major  data  extraction  efforts  entail  tabulat¬ 
ing  data  as  described  in  the  following. 

Labor  Estimates.  While  touch  labor  may 
only  be  a  small  percentage  of  a  production 
contract,  it  is  used  as  the  basis  for  nearly  all  la¬ 
bor  estimates.  In  general,  most  offerors  project 
their  support  labor  and  other  associated  pro¬ 
duction  labor  costs  as  a  percentage  of  the  touch 
labor.  This  makes  a  comprehensive  and  accu¬ 
rate  touch  labor  analysis  essential  to  the  FF 
process.  It  is  also  important  to  have  a  good 
and  complete  accounting  of  the  associated  sup¬ 
port  labor. 

The  labor  hour  estimates  are  obtained  by  sort¬ 
ing  through  the  proposal  and  extracting  the 
proposed  labor  hours  by  functions.  Use  of 


9 


technical  evaluation  forms  described  in  the  fol¬ 
lowing  paragraph  can  facilitate  this  process, 
particularly  if  the  proposal  is  poorly  organized, 
disjointed  and  difficult  to  sort  through. 
Completion  of  the  technical  evaluation  forms  is 
optional.  Whatever  method  is  used,  the  total 
labor  hours  proposed  by  functions  are  ex¬ 
tracted,  totaled  and  posted  in  the  first  two 
columns  of  Table  1  (the  balance  of  the  table  is 
filled  out  later).  The  manufacturing  functions 
used  to  sort  the  labor  hours  include: 

1.  Manufacturing  Touch  Labor 

2.  Manufacturing  Support  Labor 

•  Shop  Supervision 

•  Manufacturing/Production 
Management 

•  Production  Control 

•  Procurement/Materiel 

•  Manufacturing  Engineering 

•  Industrial  Engineering 

•  Test  Equipment  and  Tooling 
Maintenance 


This  particular  sort  of  the  labor  hours  is  re¬ 
quired  to  break-down  and  analyze  the  support 
labor  hours  by  functions.  Guidelines  have 
been  developed  over  the  years  for  support  labor 
functions  as  a  percentage  of  touch  labor  which 
are  representative  of  reasonably  efficient,  well 
managed  companies  within  the  aerospace  in¬ 
dustry.  A  departure  from  the  support  labor 
guidelines  if  not  adequately  justified  by  the 
BOEs  should  trigger  additional  examination  of 
the  proposed  support  labor  hours.  Support  la¬ 
bor  guidelines  are  contained  in  APPENDIX  IV. 

Performance  Improvement  Curve  and 
Realization  Factor  (RF)  parameters. 
For  each  proposal,  there  exist  a  minimum  set  of 
information  which  is  required  to  perform  anal¬ 
ysis  of  the  PI  Curve  and  the  RF.  These  are 
tabulated  in  Table  2  and  listed  below  with 
some  relevant  annotations: 

A.  Item.  This  is  the  item  being  manu¬ 
factured  for  which  a  cost  estimate  is 
being  provided  in  the  proposal  and 


TABLE  I 


MANUFACTURING  LABOR  SUMMARY 


MANUFACTURING 

FUNCTION 

HOURS 

RECOMMENDED 

DIFFERENCE 

%  REDUCTION 

HOURS 

% 

TOUCH 

LABOR 

MINIMUM 

PROBABLE 

MINIMUM 

PROBABI.E 

MINIMUM 

PROBABLE 

TOUCH  LABOR 

SHOP  SUPERVISION 

MFG7PROD.  MGMT. 

PROD.  CONT&PLANG 

PROCUREMENT/MATtS 

MFG.  ENGINEERING 

INDUST.  ENGINEERING 

TEST  EQUIP.  &MAINT 

TOTAL 

It  is  to  be  noted  that  some  of  the  manufacturing 
support  labor  functions  listed  may  not  be  appli¬ 
cable  to  a  particular  manufacturing  contract  and 
there  could  be  other  functions  which  need  to  be 
included  and  analyzed;  functions  should  be 
deleted  or  added  as  required  to  suit  a  particular 
contract 


which  the  fact  finder  is  evaluating. 
It  may  be  a  component,  an 
assembly,  a  subsystem,  or  the 
complete  system.  This  item  is  a 
fall-out  of  the  compartmenting 
made  to  facilitate  evaluation  of  the 
proposal  as  noted  previously.  It  is 
the  entity  to  which  all  of  the  pa- 
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rameters  to  its  right  (in  Table  2) 
must  apply. 


generally  specified  by  the  SOW  or 
by  the  offeror. 


TABLE  2 


ITEM 

LC 

% 

PRIOR 

QTY 

PROP 

QTY 

B 

LAST 

UNIT 

TMP 

STD 

HOURS 

PF 

T 1000 

F - 

T1 

Uc 

TMP 

HOURS 

(Excluding 

Scrap) 

SCRAP 

FACTOR 

TOTAL 

HOURS 

i 

- 

wm 

“ 

53 

n 

- 

A 

& 

C 

D 

E 

F 

El 

H 

m 

J 

K 

L 

M 

N 

■EW 

_ 

S 

- 

-  -  — 

55 

■ 

wm 

B  ■ 

S 

* 

■n 

■  ■ 

B.  LC  %.  This  is  the  performance 
improvement  rate  (r)  of  the  learn¬ 
ing  curve  applicable  to  tb«*  item  ex¬ 
pressed  as  a  percentage.  This  pa¬ 
rameter  is  generally  specified  and 
justified  by  the  offeror  in  his  pro¬ 
posal.  If  this  parameter  or  any 
other  parameter  listed  in  this  table 
is  judged  invalid  or  unreasonable, 
a  substitute  parameter  is  recom¬ 
mended  and  justified  by  the  fact 
finder.  An  excellent  source  of  im¬ 
provement  curve  experience  is 
tabulated  in  DCAAP  7641.14. 

C.  Quantity  of  the  item  produced  by 
the  offeror  prior  to  this  contract. 
This  parameter  is  used  to  determine 
the  offeror’s  current  position  on 
the  PI  curve  and  should  include  all 
Full  Scale  Development  (FSD)  and 
production  units  unless  grossly 
different  from  the  current  con-figu¬ 
ration. 


E.  This  is  the  sequence  number  of  the 
first  item  in  the  proposed  produc¬ 
tion  lot.  It  is  a  function  of  the 
number  of  units  previously  pro¬ 
duced  (parameter  C  above)  and  is 
numerically  equal  to  parameter  C  + 
1.  For  example,  if  C  -  50,  then 

E  =  50  +  1  =  51. 

F.  This  is  the  sequence  number  of  the 
last  unit  to  be  produced  by  this 
production  run.  It  is  numerically 
equal  tc  parameter  E  +  D.  For  ex¬ 
ample,  if  D  =  20  and  E  =  51,  then 
F  =  20  +  51  =71. 

G.  TMP  or  true  mid-point.  This  is  the 
sequence  number  of  the  item 
whose  cost  is  representative  of  the 
average  unit  cost  of  this  production 
run.  It  is  determined  by  the  for¬ 
mula  as  described  in  the  discussion 
of  the  PI  curve  found  in 
APPENDIX  L 


D.  Quantity  of  the  item  to  be  produced 
by  this  contract.  This  item  is 
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H.  STD  hours  is  the  estimated  stan¬ 
dard  time  required  by  an  average 
qualified  operator  working  at  nor- 


mal  speed  to  produce  the  line  item 
following  the  prescribed  method. 
This  estimate  is  provided  by  the 
proposal.  Reservation  noted  for 
item  B  applies. 

I.  Realization  Factor.  This  is  the 
factor  used  by  the  offeror  to  mod¬ 
ify  the  standard  time  (STD  hours, 
parameter  H)  to  account  for  al¬ 
lowed  inefficiencies  or  variances. 
The  offeror  provides  justifications 
for  each  of  the  constituents  of  the 
realization  factor.  If  the  offeror 
docs  not  adequately  justify  the  real¬ 
ization  factor  and  a  different  value 
is  deemed  more  appropriate,  the 
fact  finder  provides  a  re-com¬ 
mended  value  along  with  the  ra¬ 
tionale  for  it 

Note:  BMO  generally  recognizes 
four  variances  to  the  standard 
hours  which  comprise  the  RF  (see 
paragraph  on  analysis  of  the 
Realization  Factor).  These  include 
rework,  operator  inefficiencies, 
shop  inefficiencies,  and  engineer¬ 
ing  changes. 

J.  T  1000.  This  is  the  unit  cost 
(measured  in  touch  labor  hours)  of 
the  1000th  unit  It  is  the  total  touch 
labor  hours  required  to  produce  the 
line. item  which  is  calculated  by 
multiplying  the  STD  hours  (item 

H)  by  the  realization  factor  (item 

I) . 

K.  Tl.  This  is  the  theoretical  cost  of 
the  first  unit  (measured  in  touch  la¬ 
bor  hours).  It  is  determined  by 
constructing  the  PI  curve.  See 
APPENDIX  I  for  discussion  of  the 
PI  curve. 

L.  Uc  at  the  TMP  (true  mid-point). 
This  is  also  calculated  from  the  PI 
curve.  The  PI  curve  equation  used 
is  found  in  APPENDIX  I.  This 
parameter  is  the  average  unit  touch 
labor  cost  of  the  line  item.  The  to¬ 
tal  touch  labor  cost  of  the  line  item 
will  be  equal  to  Uc  at  the  TMP 


multiplied  by  proposal  quantity 
(item  D).  It  is  to  be  noted  that  the 
TMP  is  not  necessarily  an  integer 
and  could  be  any  decimal  number 
greater  than  one,  e.g.,  25.65. 

M.  Hours  (excluding  scrap).  This  is 
the  total  touch  labor  hours,  exclu¬ 
sive  of  the  scrap  allowance,  re¬ 
quired  by  the  line  item.  It  is  de¬ 
termined  by  the  product  of  items  D 
and  L.  Scrap  allowance  varies 
from  contractor  to  contractor  and 
the  nature  of  the  items  being  manu¬ 
factured.  It  is  therefore  best  to 
compute  the  total  touch  labor  hours 
required  less  scrap;  and  to  resolve 
scrap  allowances  separately. 

N.  Scrap  factor.  Scrap  is  usually 
given  by  the  offeror  as  a  factor 
applied  to  the  total  touch  labor 
hours.  The  factor  used  should  be 
justified  by  the  offeror.  If  it  is  not 
and  a  different  factor  is  deemed 
more  appropriate,  the  fact  finder 
provides  an  alternative  value  and 
his  rationale  for  it. 

O.  Total  hours.  This  is  the  total  touch 
labor  hours  including  scrap  re¬ 
quired  by  the  line  item. 

Technical  Evaluation  Reports/Proposal 
Evaluation  Sheets.  To  facilitate  the  ex¬ 
traction  of  the  labor  hours  from  the  proposal,  it 
is  often  desirable  to  use  the  Technical 
Evaluation  Report  and  Proposal  Evaluation 
Sheets,  Figures  3  &  4  respectively  (collectively 
referred  to  as  evaluation  forms  in  the  fol¬ 
lowing  discussion).  These  are  to  be  pre-pared 
and  tracked  by  WBS  with  task  numbers.  There 
is  to  be  only  one  task  number  per  set  of  evalua¬ 
tion  sheets.  However,  there  may  be  any 
number  of  manufacturing  functions,  labor  cate¬ 
gories,  etc.,  within  each  task  number.  The 
proposal  should  delineate  estimated  labor  hours 
by  manufacturing  functions  and  WBS  ele¬ 
ments.  These  optional  evaluation  forms,  if 
used,  are  to  be  diligently  prepared  because 
they: 

•  can  greatly  facilitate  and  ease  sorting 
of  the  data. 
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TECHNICAL  EVALUATION  REPORT 

TASK  NAME — _ _ _ _ _ 

Proposal  Pages _ _ _ 

Evaluator  Organization _ 


TASK  LABOR  CONTRACTOR  AF  OBJECTIVE  DIFFERENCE 

m  CATEGORY  PROPOSAL  HRS.  MINIMUM  PROBABLE  MINIMUM  PROBABLE 


Reason  for  Difference  Between  Proposal  and  AF  Minimum  and  Probable  Positions 


Name/Signature  of  Evaluator(s) 


Date: 


FIGURE  3.  SAMPLE  TECHNICAL  EVALUATION  REPORT  SHEET 
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•  can  be  used  as  a  source  fertile  written 
rationale  to  be  included  in  the  Tech¬ 
nical  Evaluation  Report,  and 

•  can  be  used  to  verify  that  each  manu¬ 
facturing  item  in  the  proposal  is  ac¬ 
counted  for  in  the  FF. 

It  is  to  be  noted  that: 

•  these  evaluation  forms  sort  the  pro¬ 
posal  by  WBS  elements, 

•  these  evaluation  forms  cannot  be 
fully  completed  until  FF  occurs  be¬ 
cause  some  of  the  data  entiy  columns 
are  dependent  on  the  results  of  FF. 
These  individual  evaluation  forms 
may  be  used  as  a  source  of  data  for 
the  completion  of  the  various  tables 
which  sort  the  proposal  by  manufac¬ 
turing  functions,  and 

•  these  evaluation  forms  are  often  used 
to  verify  that  each  manufactured  item 
in  the  proposal  is  accounted  for  in 
the  FF.  Furthermore,  because  there 
are  various  labor  categories,  the 
hours  in  each  labor  category  are 
often  used  by  Pricing  analysts  in  the 
accounting  for  the  ultimate  cost  dif¬ 
ference  between  proposed,  and  rec¬ 
ommended  hours. 

Labor  Hour  Estimates  of  Major  Com¬ 
ponents  and  Subassemblies.  The  propo¬ 
sal  should  contain  data  which  is  or  can  be 
sorted  for  Standard  Time  against  the  major 
components  and  subassemblies  being  assem¬ 
bled  as  shown  in  Table  3  for  the  current  and  (if 
available)  previous  buy(s). 

Where  previous  buys  exist,  ihL  sort  provides 
historical  data  for  comparative  purposes.  It 
also  facilitates  isolation  and  analysis  of 
changes/trends  in  Standard  Time  between 
buys.  This  table  provides  a  line-by-line,  item- 
by-item,  breakdown  of  the  unit  Standard  Time 
as  well  as  the  totals,  and  shows  the  percent  of 
Type  I  Standard  Tune.  This  data  son  provides 
insight  into  whether  the  offeror  is  technically 
up  to  date  and  how  the  Standard  Times  com¬ 
pare  between  buys.  If  large  changes  in  the 


Standard  Times,  components,  and  or  sub- 
assemblies  occur  between  buys  it  triggers  and 
provides  justification  for  requesting  detailed  ra¬ 
tionale  far  the  changes. 

Where  previous  buys  do  not  exist,  this  data 
sort  still  provides  visibility  relating  to  cost  of 
components  and  subassemblies  which  can  be 
used  to  assess  reasonableness  of  the  offeror’s 
estimates. 

4.3.2  Data  Analysis.  The  foregoing  FF 
tasks  extracts  and  tabulates  data  from  the  pro¬ 
posal.  The  following  delineates  analyses  re¬ 
quired  of  that  data  as  well  as  other  data  ex¬ 
tracted  from  the  proposal  or  obtained  from  the 
offeror  verbally  or  through  RFIs. 

It  is  to  be  noted  that  it  has  been  traditional  in  the 
Defense  Aerospace  Industry  to  utilize  actual 
costs  developed  during  design  development 
and  initial  (first  article)  production  to  predict 
future  touch  labor  expenditures.  However, 
"actuals"  tend  to  be  distorted  and  inflated  as  the 
result  of  design  problems,  rework,  and  scrap 
early  in  a  program  and  is  not  representative  of 
what  is  achievable.  Therefore,  "actuals"  used 
*s  basis  of  touch  labor  estimates  should  be 
closely  examined  and  not  accepted  off  hand. 

The  normal  purpose  for  applying  performance 
curves  to  time  standards  is  to  back  the  standard 
"up"  the  curve  to  determine  realized  hours  at 
points  prior  to  reaching  peak  efficiency  (or 
steady  state  variance). 

This  is  where  there  is  generally  philosophical 
disagreement  with  contractors  despite  the  fact 
that  the  use  of  standards  is  mandated  by  MIL- 
ST£M3i17A.  The  contractors  usually  base 
thei/  "estimates"  on  actuals  and  project  "down" 
the  curve  accepting  their  inefficiencies  and  we 
base  our  estimate  on  a  standard  and  go  up  the 
curve  basing  it  on  reasonable  variances. 

To  support  the  development  of  ar.  independent 
cost  estimate  (paragraph  4.5.1)  of  tbs  touch  la¬ 
bor,  three  items  are  required: 

1 .  An  analysis  of  the  touch  labor  based  on 
MIL-STD-1567A  Work  Measurement 
Standards, 
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2.  A  developed  Realization  Factor,  and 

3.  A  selected  PI  Curve 

» 

From  this  data  and  curve,  the  average  unit  pro¬ 
duction  cost,  in  hours,  of  the  production  lot  can 
be  established.  Negotiating  from  this  position 
is  most  cost  effective  and  the  areas  of  dis¬ 
agreement  are  contained  in  narrow  parameters 
of  performance. 

Examination  of  Basis  of  Estimates. 
Detailed  rationale  and  justification  for  each  pro¬ 
posed  WBS  task  and  labor  function  should  be 
included  in  the  proposal.  These  BOEs  should 
be  reviewed  to  ascertain  that  all  estimates  are 
justified  and  reasonable.  Special  attention 
should  be  devoted  to  areas  indicated  through 
examination  of  Tables  1, 2  and  3  wherein  rea¬ 
sonableness  is  in  doubt  or  estimates  are  not 
consistent  with  expectations. 

Examination  of  Data  For  Obvious 
Errors.  Following  sort  and  tabulation  of  the 
data  into  Table  1, 2  and  3,  scan  the  data  to  iso¬ 
late  and  eliminate  obvious  errors.  Errors  in¬ 
clude  instances  wherein  a  cost  or  cost  factor  is 
improperly  applied  or  applied  more  than  once. 

Analysis  of  Realization  Factor  (RF). 
The  proposal  should  clearly  denote  the  realiza¬ 
tion  factor  used  together  with  a  breakdown  of 


how  the  variance  categories  contribute  to  the 
total  RF.  The  BMO  recommended  and  fre¬ 
quently  used  variance  categories  are: 

1.  Reworic  Departures  from  the  stan¬ 
dards  caused  by  any  corrections  of 
defective  work  either  before, 
during,  or  after  inspection. 

2.  Operator  Inefficiency:  Departures 
from  the  standards  attributable  to 
personnel  turnover,  absenteeism, 
idle  time,  etc. 

3.  Shop  Inefficiencies:  Departures 
from  the  standards  due  to  material 
shortages,  faulty  and  broken  tools, 
defective  material,  etc. 

4.  Engineering  Changes:  Departures 
from  the  standards  caused  by  engi¬ 
neering  changes. 

Some  additional  variances  which  often  must  be 
considered  are  yield,  precision  machining  and 
assembly,  and  restrictions  in  assembly.  When 
such  is  die  case  adjustments  to  the  Realization 
Factor  are  made  and  justified  by  the  offeror. 

A  listing  of  the  appropriate  variance  categories 
by  percent  of  standard  for  the  proposed  RF 
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should  be  included  with  justification  for  each  of 
the  proposed  variances.  Tins  variance  analysis 
allows  examination  of  how  the  non-work  con- 
tributes  to  the  work  inefficiencies  and  to  de¬ 
termine  opportunities  for  improvements. 

The  Realization  Factor  is  generally  developed  at 
a  position  of  steady  state  variance.  Steady  state 
is  said  to  occur  when  the  expected  variance  im¬ 
provement  becomes  too  small  to  measure. 
Since  this  point  takes  place  far  in  the  future, 
tooling,  fixture  design,  and  similar  variances 
are  resolved  and  the  remaining  variances  are 
easier  to  determine  and  control.  The  steady 
state  variances  can  then  be  broken  into  the  four 
categories  as  noted  above.  The  lOOOth  unit  is 
commonly  accepted  as  the  point  at  which 
steady  state  variance  occurs. 

Performance  Improvement  Curve 
Rationale  and  Justification.  The  pro  ¬ 
posed  PI  curve  should  be  rationalized  and  jus¬ 
tified  in  the  proposal.  The  factors  (slope,  stan¬ 
dard  hours,  etc.)  used  in  the  construct  of  the 
curve  should  be  clearly  delineated  and  justified. 

A  description  of  the  improvement  curve,  its 
applicability,  and  construction  is  described  in 
APPENDIX  I.  DCAAP  7641.14  is  a  useful  ' 
resource  for  PI  curve  rationale. 

Scrap  Allowances.  The  scrap  allowances 
used  by  the  offeror  should  be  identified  and 
justified.  Scrap  merits  special  attention  because 
it  can  cause  difficulties  if  not  squarely  ad¬ 
dressed  up  front.  It  is  often  inadvertently  allo¬ 
cated  at  tits  lowest  component  levels  and  again 
at  one  or  more  ascending  levels  of  assembly. 
Some  contactors  additionally  include  it  in  their 
RF.  This  is  a  clear  mis-application  of  the  scrap 
factor,  other  inadvertent  misapplications  are 
however  more  subtle  and  difficult  to  uncover. 

It  is  therefore  necessary  to  not  only  determine 
the  offeror's  scrap  rate  but  to.  also  determine 
where  and  how  it  is  accounted  for. 
Examination  of  the  scrap  allowances  should 
also  be  performed  to  determine  validity  and  to 
facilitate  forecast  of  potential  improvement 

Man  Loading.  The  proposed  man  loading 
curves  for  overlapping  production  buys  should 
be  included  in  the  proposal.  This  data  is  exam¬ 
ined  to  assure  that  all  efforts  to  be  performed 
during  this  overlapping  period  are  properly 


allocated  to,  and  expended,  against  the 
appropriate  buys. 

Tooling  Costs.  Tooling  cost  (original  and 
replacement  cost)  to  be  used  for  this  production 
buy  should  be  determined  The  cost  should 
include  material  and  labor  and  rationale/justifi- 
cation  for  the  proposed  tooling  maintenance 
dollars  and  hours. 

Tooling  initially  purchased  for  the  program  is 
supplemented  and  maintained  as  the  program 
progresses.  When  specific  tooling  is  identi¬ 
fied,  together  with  iu  use  and  wearability,  the 
need  for  either  repkv-oment  and  maintenance  is 
more  discemable.  When  both  hours  and  dol¬ 
lars  are  called  out,  ratios  to  touch  labor  and  ini¬ 
tial  cost  can  be  developed,  assessed,  and  eval¬ 
uated  for  reasonableness. 

Labor  Standards  Evaluation.  When  stan¬ 
dards  coverage  per  MIL-STD-1567A  is  ques¬ 
tionable,  establish  Table  3  from  data  in  the  pro¬ 
posal.  If  the  proposal  does  not  contain  the  data 
necessary  to  complete  the  table,  prepare  RFIs 
as  appropriate  to  obtain  the  data.  This  data  can 
be  used  to  evaluate  the  Standard  Time  and  to 
calculate  and  record  the  data  which  will  be 
needed  to  establish  the  recommended  hours  for 
the  touch  labor  time. 

In  evaluating  the  Standards,  comparison  can  be 
made  between  years  on  a  line-by-line  and  total 
basis  to  detect  changes.  Also,  if  the  percentage 
of  Type  I  Standards  are  not  at  the  level 
required,  appropriate  questions  can  be  raised  as 
to  why  and  when  the  deficiency  is  to  be  cor¬ 
rected.  Additionally,  these  revelations  can 
support  rationale  that  questions  not  only  the 
validity  of  the  Standards  but  whether  time  spent 
in  setting  required  Standards  after  the  fact  could 
have  been  spent  more  wisely  and  more  to  the 
government’s  advantage  working  on  methods 
improvements,  etc.  as  should  be  the  case  to 
hopefully  reduce  the  Standards  and  thereby  the 
cost  to  the  government 

4.4  FF  Meeting  (Phase  HI) 

In  this  phase,  the  FF  team  meets  with  the 
offeror.  Ideally,  this  meeting  is  held  at  the 
offeror’s  facility  to  permit  as  the  need  arises 
first-hand  inspection  by  the  team  of  the  pro¬ 
duction  facilities  and  processes.  The  meeting  is 
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generally  chaired  by  the  project  officer  or  his 
designee. 

4.4.1  General  FF  Guidance.  Generally 
at  manufacturing  FF  meetings,  the  offeror 
presents  his  proposal  and  the  proposed  labor 
hours.  The  actual  conduct  of  the  meeting  and 
proposal  review  vary  and  are  generally  a  matter 
of  style;  different  project  officers  and  lead 
Department  of  Defense  personnel  conduct  FF 
differently  depending  on  personal  preference, 
or  experience  with  the  specific  offeror,  or  the 
nature  of  the  production  buy.  Some  conduct  a 
page  by  page  review  starting  at  the  beginning 
of  the  proposal  and  sequentially  work  through 
each  proposal  section.  Others  form  separate 
side  meetings  which  are  assigned  responsibility 
of  separate  sections/disciplines 

As  the  offeror  presents  his  proposal  estimated 
hours  and  data,  the  fact  finders  review  these 
hours,  the  data  used  to  compute  them,  the 
method  of  computation,  and  the  related  ra¬ 
tionale  provided  to  establish  their  validity. 

The  FF  team  evaluates  the  presentations  and 
data  presented.  Under  ideal  circumstances,  the 
FF  team  has  had  sufficient  data  (extracted  from 
the  proposal  and  the  offeror  responses  to  RFIs) 
and  time  to  make  an  assessment  of  the  proposal 
and  labor  hours  and  can  formulate  and  ask 
questions  to  gather  any  further  information 
deemed  necessary  to  examine  the  offeror's 
proposal  or  to  substantiate  a  government  .posi¬ 
tion,  Questions  should  be  formulated  and 
asked  such  that  the  fundamental  differences  are 
addressed  in  such  a  manner  as  to  either  resolve 
the  issue  or  document  a  disagreement.  The 
idea  is  to  resolve  as  many  issues  as  possible  at 
the  face  to  face  meeting.  At  the  FF  meeting 
additional  RFIs  arc  in  order  and  should  be 
submitted  as  agreed  upon  at  the  onset  of  the 
meeting.  The  offeror’s  answers/responses  are 
noted,  evaluated,  and  a  technical  assessment  of 
the  proposal  is  made. 

At  all  times  during  the  meeting,  the  fact  finder 
should  be  "up  front"  with  the  offeror.  The  fact 
finder  should  share  with  the  offeror,  his  find¬ 
ings  from  the  review  of  the  proposal. 
Furthermore^  as  appropriate,  the  fact  finders 
should  inform  the  offeror  where  he  stands  on 
proposal  estimates,  diset  spancies,  and  prob¬ 
lems— and,  what  his  expectations  are. 


Generally  it  is  a  good  idea  not  to  withhold  any 
information  from  the  offeror  and  avoid 
"surprising"  the  offeror.  A  well  informed  of¬ 
feror  is  in  a  better  position,  and  likely  to  be 
more  motivated,  to  respond  to  and  resolve 
discrepancies,  omissions,  and  problems.  Fact 
finders  need  to  quickly  establish  a  good  work¬ 
ing  rapport  with  the  offeror  and  work  together 
to  resolve  the  items  identified  for  fact  finding 
focus  during  the  proposal  review.  It  is  to  be 
noted  that  not  all  issues,  discrepancies  will  be 
satisfactorily  resolved  during  the  meeting.  This 
is  acceptable,  as  long  as  both  sides  fully  un¬ 
derstand  the  others  position. 

At  the  completion  of  the  FF  meeting,  the  fact 
finder  should  have  discussed  his  concerns.  He 
should  have  in  hand  the  contractor’s  proposed 
justification  for  discrepancies,  or  commitments 
which  will  resolve  them.  He  should  certainly 
leave  the  FF  meeting  with  sufficient  in-forma¬ 
tion  to. substantiate  all  positions  and  recom¬ 
mendations  which  he  will  make  in  the 
Technical  Evaluation  Report,  or  with  firm 
commitments  by  the  offeror  that  the  needed 
information  is  forthcoming  in  a  timely  fashion. 

4.5  Technical  Evaluation  (Phase  IV) 

4.5.1  Preparation  of  Independent  Cost 
Estimate.  As  a  fallout  of  the  above  data 
analyses  and  the  fact  finding  meeting,  the  fact 
finder  should  have  a  good  feel  for  the  cost 
parameters  appropriate  for  this  offeror  on  this 
production  effort.  Recommended  adjustments 
to  the  manufacturing  cost  parameters  listed  in 
Table  2  are  determined  and  documented  by  the 
fact  finder.  These  adjustments  take  the  form  of 
different  recommended  cost  parameters  such  as 
performance  improvement  rate,  RF,  Standard 
Time,  Scrap  factor,  etc.  Where  appropriate, 
the  cost  parameters  used  by  the  offeror  are  to 
be  applied  and  where  adjustments  are  deemed 
necessary,  the  fact  finder’s  recommended  para¬ 
meters  should  be  used. 

Having  established  the  performance  improve¬ 
ment  rate  r,  the  Standard  Time,  and  the 
Realization  Factor  at  the  steady  state  unit,  the 
PI  Curve  can  be  developed  from  which  the  av¬ 
erage  unit  cost  and  the  total  production  lot  cost 
can  be  computed.  The  Unit  Cost  Curve 
Method  is  used  and  is  discussed  in 
APPENDIX  I. 
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The  end  objective  is  to  arrive  at  a  cost  position 
consisting  of  a  minimum  and  maximum  re¬ 
commended  estimates  in  hours.  The  minimum 
is  representative  of  the  performance  achievable 
by.a  well  managed,.  motivated  and  reasonably 
efficient  contractor  with  standard  manufactur¬ 
ing/management  practices.  The  maximum  cost 
is  normally  the  cost  representing  the  upper 
bound  beyond  which  cost  would  be  unaccept¬ 
able,  unreasonable  or  indicative  of  excessive 
inefficiencies  on  the  part  of  the  offeror. 

Generally,  the  minimum  cost  is  determined 
from  the  construction  of  the  PI  curve.  The  PI 
curve  is  constructed  using  the  parameters  pro¬ 
vided  by  the  offerer  adjusted  as  appropriate  by 
the  fact  finder,  In  all  cases,  all  adjustments 
made  by  the  fact  finders  are  documented  and 
include  complete  justification  for  the  adjust¬ 
ments  made. 

Factors  affecting  the  maximum  cost  position 
are  manifest  and  vary  widely.  In  general,  there 
is  no  single  approach  or  formula  for  the  devel¬ 
opment  of  this  position^ 

4.5.2  Projection  of  Recommended 
Hours.  Using  the  independent  cost  estimate 
prepared  above  as  basis,  recommended  hours 
are  entered  into  Table  1.  The  recommended 
hours  should  include  two  values:  a  minimum 
value  and  a  maximum  value.  These  recom¬ 
mended  hours  are  derived  from  the  cost  posi¬ 
tion  arrived  at  in  4.5.1,  however  adjustments 
can  be  made  for  reason  as  long  as  the  basis  of 
the  adjustments  are  sound  and  well  docu¬ 
mented.  These  are  provided  to  the  Air  Force 
contract  negotiators  and  must  be  well  substan¬ 
tiated  particularly  if  they  depart  widely  from  the 
offeror’s  estimates  (proposal).  The  minimum 
is  used  as  negotiations  leverage  and  the  maxi¬ 
mum  is  to  denote  the  recommended  high  end 
negotiating  position. 

4.5.3  Identification  of  Focus  Areas 
for  Negotiations.  The  results  of  the  inde¬ 
pendent  cost  estimate  are  compared  to  the  of¬ 
feror's  proposal  to  identify  areas  of  discrepan¬ 
cies.  These  areas  are  examined: 

•  to  ensure  there  are  no  mistakes  in  the 
independent  cost  estimate, 


•  to,  if  possible,  isolate  the  fundamen¬ 
tal  cause(s)  for  the  discrepancies  for 
attention  of  the  offeror, 

•  to  ascertain  that  the  discrepancies  are 
consistent  with  the  fact  finders  ex¬ 
pectations  given  his  knowledge  of 
the  parameters  associated  with  this 
production  effort,  and 

•  to  give  the  project  officer  a  rough 
idea  of  the  magnitude  of  the  differ¬ 
ences  between  hours  proposed  and 
hours  recommended  by  the  fact 
finders. 

These  areas  are  coordinated  with  the  project 
officer  to  establish  the  BMO  position  and  as 
appropriate  identified  for  special  focus  during 
negotiations. 

4.5.4  Technical  Evaluation  Report. 
The  Technical  Evaluation  Report  is  to  be  pre¬ 
pared  in  accordance  with  the  requirements  of 
BMO  Engineering  Directive  82-3.  It  is  a  very 
important  document  which  must  be  diligently 
prepared.  To  be  useful  in  the  negotiations  pro¬ 
cess,  the  technical  report  must  stand  on  its  own 
and  cite  reasons  for  findings  sufficiently  com¬ 
pelling  to  prevail  during  negotiations.  The 
Technical  Evaluation  Report  is  used  as  a  basis 
fon 

a.  Further  FF  with  the  offeror 

b.  Development  of  (1)  a  minimum  and 
(2)  a  most  probable  position  for  use  in 
the  pre-negotiations  conference 

c.  Development  of  the  specific  negotia¬ 
tion  plan  and  as  a  specific  guide  during 
negotiations. 


APPENDIX  I:  PERFORMANCE 
IMPROVEMENT  CURVE 


APPENDIX  I.  PERFORMANCE 
IMPROVEMENT  CURVE 

Introduction.  The  learning  curve  is  a  pro¬ 
duction  management  tool  that  has  been  found 
useful  in  a  number  of  applications  which  in¬ 
clude  cost  estimating,  production  planning, 
setting  cost  objectives  and  cost  controls,  pro¬ 
posal  evaluation,  and  contract  negotiation. 
Historically,  the  largest  single  use  has  been  in 
cost  estimating,  the  focus  of  this  appendix. 
Much  of  the  material  presented  here  is  patterned 
after  L.  M.  Matthews’  Estimating 
Manufacturing  Costs  —  A  Practical 
Guide  for  Managers  &  Estimators, 
McGraw  Hill  Book  Company,  1983 

The  learning  curve  or  performance  improve¬ 
ment  curve  is  an  empirically  developed  rela¬ 
tionship  between  the  labor  hours  required  to 
produce  a  unit  of  output  and  the  number  of 
units  produced.  The  labor  hours  obtained  from 
the  learning  curve  may  be  the  time  required  to 
produce  a  specific  unit  (unit  cost  curve  a.k.a. 
Crawford  curve)  or  the  cumulative  average  time 
per  unit  through  the  unit  of  interest  (cumulative 
average  cost  curve  a.k.a.  Wright  curve).  The 
primary  use  of  the  learning  curve  is  in  taking 
manufacturing  labor  hours  developed  as  a  point 
estimate  (first  unit,  actual,  or  standard  time) 
and  relating  it  to  a  quantity  of  items  to  be 
manufactured. 

BSD,  like  the  large  majority  (92%)  of  respon¬ 
dents  in  an  Air  Force  study,  uses  die  unit  cost 
curve  for  their  cost  estimating/  evaluating  ef¬ 
forts1.  Therefore,  unless  noted  otherwise,  all 
discussions  in  this  appendix  relate  to  the  unit 
cost  curve.  The  advantages  for  using  the  unit 
cost  curve  are  discused  in  references  1  and  2 
and  will  not  be  repeated  here.  The  term  most 
often  used  by  BSD  in  relating  to  the  unit  cost 
curve  is  the  performance  improvement  (PI) 
curve  and  these  are  used  interchangeably  in  this 
discussion.  The  importance  of  understanding 
the  basis  and  application  of  the  PI  curve  can  not 
be  over  emphasized.  It  is  a  key  element  of 
manufacturing  fact  finding  as  practiced  by  BSD 
and  all  managers  and  fact  finders  should  be 
conversant  with  it  and  alert  to  its  applications. 
The  purpose  of  this  appendix  is  to  provide  a 
description  of  the  PI  curve  and  delineate  its 


application  to  fact  finding  to  better  serve  the 
need  of  users. 

Background  of  the  Performance 
Improvement  Curve.  T.  P.  Wright  of  the 
Curtiss-Wright  corporation  is  generally  credited 
as  the  father  of  the  learning  curve.  An  aero¬ 
nautical  engineer,  Wright  managed  the  Gurtiss- 
Wright  plant  in  Buffalo,  NY.  In  studying  his 
past  actual  cost  of  building  airframes,  he 
observed  the  following  phenomenon:  With 
each  doubling  of  the  quantity  of  airframes 
produced,  the  cumulative  average  cost  at  the 
doubled  quantity  bore  a  fixed  and  lower 
relationship  to  the  cumulative  average  cost  at 
the  previously  undoubled  quantity.  Wright 
published  his  finding  in  the  February  1936 
issue  of  the  Journal  of  Aeronautical 
Sciences.  Initially,  Wright's  article  caused 
no  great  furor  in  American  manufacturing  or 
management.  However,  the  outbreak  of  WW 
II  caused  a  frantic  expansion  of  the  airframe  in¬ 
dustry.  Simultaneously,  tremendous  pressure 
was  exerted  oh  the  industry  by  the  government 
who  wanted  to  know  how  many  airframes  can 
be  delivered  next  month?  And  the  month  after? 
For  want  of  a  predictive  tool,  the  industry 
adopted  Wright's  learning  curve,  invested  a  lot 
of  talent  to  work  on  it  and  refined  it,  and  used  it 
with  great  authority  and  effect.  During  and 
following  WW  II,  the  Air  Force  collected  and 
studied  cost  data  from  airframe  manufacturers 
as  more  and  more  air  planes  were  produced. 
Empirically,  these  studies  confirmed  and 
established: 

•  The  time  required  to  perform  a  task 
reduces  as  the  task  is  repeated- 

•  The  amount  of  improvement  decreases 
as  more  units  are  produced. 

•  The  rate  of  improvement  has  sufficient 
consistency  to  allow  its  use  as  a 
predictive  tool. 

Today,  use  of  the  performance  improvement 
curve  is  common  place  in  the  airframe  industry. 
While  the  performance  improvement  curve  has 
it  genesis  in  the  airframe  industry,  it  has  been 
found  to  be  applicable  to  most  manufacturing 
activities. 
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Performance  Improvement  Curve 
Formula.  The  phenomenon  observed  by 
Wright,  viz.,  as  the  quantity  of  an  item  pro¬ 
duced  is  doubled,  the  cost  decreases  at  a  con¬ 
stant  rate,  is  formulated  in  the  PI  curve.  It  is 
emphasized  that  the  key  operative  terms  are 
"doubled"  and  "rate"  —  with  production  of 
successive  units,  the  cost  decrease  will  be  suc¬ 
cessively  smaller  but  the  rate  of  decrease  will 
be  constant  And,  the  rate  of  decrease  applies 
to  doubled  quantities. 

This  cost-quantity  relationship  is  expressed  by 
the  equation 

C  -  a(x)b,  (1) 

where  Cx  =  Cost  ofthexth  unit 

a  =  Theoretical  cost  of 
the  first  unit 

X  =  The  xth  unit  in  the 
production  sequence 

b  =  Slope  constant  of  the 
PI  curve 

=  logr/Iog2  (2) 


Associated  with  the  PI  curve  is  a  parameter 
called  the  True  Mid  Point  (IMP)  or  the  alge¬ 
braic  mid  point  of  the  production  lot  It  is  de¬ 
fined  as  the  point  in  each  lot  at  which  the 
estimated  production  cost  or  hours  on  the  PI 
curve  equals  the  average  for  the  entire  lot  It  is 
determined  by  the  equation: 

TMP  =  [{N  x  (1  +  b)}/{(L  +  0.5) 1+b 
-  (F  -  0.5)  l+b}]*l/b  (3) 

where:  N  =  Number  of  units  in  the 
production  lot 

F  =  Production  unit  number  of  the 
first  unit  in  the  lot 

L  =  Production  unit  number  of  the 
last  unit  in  the  lot 

b  =  Slope  constant  of  the  PI  curve 

This  parameter  is  used  to  determine  the  total 
cost  of  the  production  run  being  evaluated. 

Performance  Improvement  Curve 
Example.  To  illustrate  the  foregoing,  con¬ 
sider  the  following  example: 


UNIT 

LABOR  HOURS  ' 

REDUCTION  IN 

REDUCTION 

NUMBER 

REQDTO 
PRODUCE  UNIT 

LABOR  HOURS 

% 

1 

1000 

2 

900 

100 

10 

4 

810 

90 

10 

8 

729 

81 

10 

16 

656 

73 

10 

32 

591 

65 

10 

64 

531 

60 

10 

128 

478 

53 

10 

256 

431 

47 

10 

512 

387 

44 

10 

1000 

349 

r  =  Performance  improvement 
rate 

=  complement  of  the  cost 
reduction  occurring  as 
produced  quantities  double 


This  is,  of  course,  a  contrived  example  for 
illustrative  purposes  only.  In  reality,  all  cost 
data  points  rarely  fall  exactly  on  the  curve. 
Clearly,  in  this  example,  as  the  quantity 
doubles,  a  10  percent  reduction  in  cost  is 
realized.  Thus  r,  the  performance  improvement 
rate,  is  90%  (100% -10%). 


1-2 


Mathematically,  the  slope  constant  b  is  deter¬ 
mined  by  equation  (2): 

b  =  log  r/log  2 

b  =  log  0.90/log  2  =  -0.152 

Thus,  since  the  first  unit  cost  (measured  in 
labor  hours)  in  this  example  is  1000,  from 
equation  (1): 

Cx  =  1000(x)  '°*152 

and  for,  say  the  eighth  unit, 

C8  =  1000(8)'0-152 

Cg  =1000(0.729)  =  729 

The  TMP  for  this  lot  of  1000  is  determined 
from  equation  (3)  and  is: 

TMP  =  [{1000  x  (1  -  0. 152) }/{( 1000  + 
0.5)  1-0-152  -  (l  .  0.5)  1-0.152 )]-l/-0.152 

TMP  =  [{1000  x  (0.848)}/{ (1000.5) 
0.848  .  (0.5)  0.848}]  6.579 

TMP  =  340.62 

And  the  average  unit  cost  (hours  to  produce)  of 
the  lot  is,  from  equation  (1): 

Cx  =  a(x)b 

Cavg  =  1000(340.62)'0-152 
CaVg  =  412.19  hours 

Characteristics  of  Performance 
Improvement  Curves.  Two  important 
characteristics  of  the  performance  improvement 
curve  are  evident  in  this  example.  The  first  is 
the  rate  of  change  is  constant,  i.e.,  10%  in  this 
case,  and  the  change  is  always  downwards  if 
performance  improvement  is  being  realized. 
Therefore,  the  slope  constant  b  is  always 
negative.  The  second  characteristic  is  the  size 
of  the  reductions  in  hours  required  to  produce 
the  item  is  decreasing  as  produced  quantities 
increases.  That  is  to  say,  as  successive  units 


are  produced,  the  reduction  in  hours  becomes 
successively  smaller.  The  hours  of  reduction 
are  always  positive,  though  smaller  and  smaller 
as  production  increases.  Mathematically,  the 
performance  improvement  curve  is  asymptotic. 
And  because  the  rate  of  change  is  constant, 
when  plotted  on  log-log  coordinates,  the  per¬ 
formance  improvement  curve  is  a  straight  line. 

One  can  readily  visualize  the  utility  of  the  ?I 
curve  for  estimating  the  cost  of  future  units 
when  cost  data  on  early  production  is  available. 
During  fact  finding,  however,  early  production 
run  data  is  often  not  available,  i.e.,  production 
has  not  been  initiated  or  not  yet  authorized. 
None  the  less,  as  will  be  seen  later,  the  perfor¬ 
mance  improvement  curve  is  still  a  powerful 
tool  for  estimating  manufacturing  cost. 

Figure  I- 1  graphically  illustrates  the  PI  curve. 
As  noted  earlier,  when  plotted  on  log-log  co¬ 
ordinates,  the  PI  curve  is  a  straight  line. 
During  proposal  evaluations,  BMO  fact  finders 
routinely  construct  PI  curves  not  only  to 
facilitate  evaluation  of  the  offeror’s  bid  but  to 
develop  independent  cost  estimates  (actually 
these  are  cost  positions:  the  minimum  cost  and 
maximum  cost  recommendations).  To  con¬ 
struct  the  PI  curves,  several  parameters  are  re¬ 
quired.  Generally  these  parameters  are 
contained  in  the  offeror's  proposal.  Often, 
however,  these  parameters  are  disputed  and 
disallowed  by  the  fact  finders.  In  these  situa¬ 
tions,  the  fact  finders  make  adjustments  to  the 
parameters  and  uses  them  in  the  construction  of 
the  PI  curve.  Fact  finders,  of  course,  must 
provide  justification  for  their  estimates 
(adjustments).  The  significant  para-meters 
required  to  construct  a  PI  curve  are: 

•  Standard  Time.  This  is  the  time  re¬ 
quired  by  an  average  qualified  worker 
to  perform  a  task  at  a  normal  pace,  to 
complete  an  element,  cycle,  or  opera¬ 
tion,  using  a  prescribed  method.  It  is 
based  on  the  Type  I  touch  labor 
standards  developed  and  maintained 
by  the  contractor  as  mandated  by 
M1L-STD-1567A. 

It  includes  allowances  for  personal, 
fatigue,  and  unavoidable  delays 
(PF&D). 
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LABOR  HOURS  REQUIRED  TO  PRODUCE 


Performance  Improvement  Rate. 
This  parameter  is  a  percentage  figure 
that  represents  the  slope  (constant  rate 
of  improvement)  of  the  curve.  It  is 
the  complement  of  the  improvement 
rate  being  realized.  In  the  example 
used  previously,  the  cost  reduction 
rate  for  doubled  quantities  is  10%. 
The  performance  improvement  rate  is 
therefore  100%  minus  10%  or  90% 
and  the  resulting  curve  is  said  to  be  a 
90%  PI  curve.  Knowing  the  perfor¬ 
mance  improvement  rate,  the  PI  curve 
slope  factor  b  defined  by  equation  (2) 
can  be  determined. 

Realization  Factor.  This  factor  is  a 
measure  of  the  overall  performance 
efficiency.  It  is  used  to  determine  the 
touch  labor  hours  (cost)  of  the  1000th 
unit  produced  as  follows: 

Touch  Labor  Hours  =  Std  Time  x  (RF) 

The  reciprocal  of  the  RF,  i.e., 

1/RF  =  Efficiency  (both  management 
and  operator). 


Construction  of  Performance  Improve¬ 
ment  Curve.  Construction  of  the  perform¬ 
ance  improvement  (PI)  curve  is  straight 
forward  provided  the  parameters  described 
above  (which  uniquely  determine  the  curve)  are 
available.  To  construct  the  curve,  one  needs  to 
simply  apply  the  realization  factor  to  the' 
standard  time  and  plot  this  point  on  log-log 
coordinates  at  unit  1000.  The  curve  is  then 
plotted  as  a  straight  line  through  this  point  with 
the  appropriate  slope.  To  facilitate  plotting  the 
curve,  equation  (2)  can  be  used.  For  example, 
suppose  the  following  parameters  apply  to  a 
particular  manufacturing  operation  for  which 
we  want  to  estimate  ,  the  total  production  cost: 

RF  =  1.32 

Performance  Improvement  Rate  -  80% 

Standard  Time  =  100  hours 

Production  Lot  Size  =  100  units 

Number  of  First  Unit  in  Lot  =  (no  prior 
production) 

Applying  the  RF  to  the  standard  time  deter¬ 
mines  the  actual  (touch  labor)  hours  required  to 
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produce  the  item  when  changes  to  the  variances 
have  diminished  to  sufficiently  low  levels  that 
steady  state  production  is  assumed  achieved. 
BSD  uses  the  1000th  unit  as  the  point  in 
production  where  this  occurs.  This  point  is 
plotted  as  shown  in  figure  1-2.  Using  equation 
(2),  the  slope  constant  b  is  determined  as 
follows. 

b  =  log  0;80/log  2 
=  -  0.322 

Which  yields  the  equation  for  the  PI  curve 
Cx  =  a(x)  -  0-322 


which  finally  yields  the  following  PI  curve 
equation: 

Cx  =  1222  (X)  -  0-322 

Together  with  the  cost  of  the  1000th  unit  we 
have  two  points  from  which  the  PI  curve  can 
be  constructed.  Figure  1-2  illustrates  the 
resulting  PI  curve.  From  this  curve  (or  equa¬ 
tion)  the  cost  of  any  unit  can  be  determined. 

To  determine  the  total  cost  of  producing  this  lot 
of  100  units,  the  TMP  must  be  determined. 
Using  equation  (3), 


o 

o 


To  determine  the  theoretical  first  unit  cost  (a), 
we  simply  use  the  cost  of  the  1000th  unit  in 
this  equation: 

Ciooo  =  a(1000)-  0-322 

100x1.32  =  a(0.108) 

a  =  132/(0.108) 

=  1222  hours 


TMP  =  [{100  x  (1  -  0.322) }/{ (100  + 
0.5)  1-0-322  .  (i .  0.5)  1-0.322 )]-l/-0322 

TMP  =  [{100  x  (0.678) )/{ (100.5)  °-678  - 
(0.5)  0.678}]3.106 

TMP  =  32.29 
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The  average  cost  of  this  lot  of  100  unit  is  then 
equal  to: 

Average  cost  =  1222  (TMP)  *  0-322 
Average  cost  =  1222  (32.29)  *  0-322 
Average  cost  =  1222  (0.327) 

Average  cost  =  399.16  hours 

And  the  total  estimated  cost  of  this  lot  of  100 
unit  is 

Total  estimated  cost  =100  x  Average  cost 

Total  estimated  cost  =  100  x  399.16  = 
39916  hours 


The  difficulty  in  developing  the  PI  curve  lies  in 
the  determination  of  the  parameters  (the  slope 
constant,  the  Standard  Hme  of  the  1000th  unit, 
and  the  realization  factor)  which  uniquely 
determine  a  PI  curve.  These  parameters  are 
often  embedded  in  the  offeror’s  proposal  and 
must  be  isolated  and  evaluated  to  determine 
their  validity/appropriateness  against  the 
manufacturing  effort  proposed.  If  these  pa¬ 
rameters  are  deemed  not  appropriate,  they 
should  be  disallowed  with  reasons  delineated. 
The  fact  finder  is  then  required  to  select  and 
justify  the  appropriate  parameters  to  allow 
development  of  the  independent  cost  estimate. 


Additional  Characteristics  of  the  PI 
Curve.  By  its  name,  the  PI  curve  focuses  at¬ 
tention  on  performance  improvement.  Table  I- 
1  lists  a  sample  of  elements  which  have  been 
shown  to  contribute  to  performance  improve¬ 
ment.  From  this  table  it  is  evident  that  the  total 
improvement  is  derived  from  a  combination  of 
personnel  learning  and  management  action. 
While  some  studies  have  been  conducted,  there 
is  no  general  rule  concerning  the  relative 
contribution  of  the  specific  elements.  There  is 
evidence  in  a  study3  done  by  Cochran  that 
Touch  Labor  learning  equates  to  7  percent  on 
an  85  percent  curve.  A  more  reasonable  and 
correct  interpretation  notes  that  this  is  a  very 
small  contribution  and  recognizes  that  the 


greatest  percentage  of  learning  by  far  is 
attributable  to  management.  It  is  important  to 
recognize  the  role  of  management  in  achieving 
these  improvements  and  to  ensure  that  appro¬ 
priate  management  actions  arc  taken  in  a  timely 
manner. 

There  is  a  wide  variability  in  PI  curves. 
Different  contractors  have  different  understand¬ 
ing  of  improvement  curves  and  therefore 
different  PI  curves.  Different  manufactured 
items  have  different  PI  curves.  The  studies 
performed  by  the  Air  Force  following  and 


Table  1-1.  Factors  Affecting  Performance  Improvement 


WORKER  LEARNING 
SUPERVISORY  LEARNING 
REDUCTIONS  IN  CROWDED  WORKSTATIONS 
TOOLING  IMPROVEMENTS 
DESIGN  PRODUCTIVITY  IMPROVEMENTS 
REDUCED  ENGINEERING  LIAISON 
IMPROVED  WORK  METHODS 
IMPROVED  PLANNING  AND  SCHEDULING 
INCREASED  LOT  SIZES 
REDUCED  ENGINEERING  CHANGE  ACTIVITY 
REDUCTION  IN  SCRAP  AND  REWORK  . 
OPERATION  SEQUENCING  AND  SYNCHRONIZATION 


Source:  DoD  Manufacturing  Management 
Handbook,  July  1984 
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during  WW  II  resulted  in  the  following 
important  findings  on  the  PI  curve 
phenomenon: 

•  Different  performance  improvement 
curves  are  developed  for  different 
airframes. 

•  When  the  same  airframe  is  produced 
by  different  companies,  the  compa¬ 
nies  have  different  PI  curves. 

•  When  the  same  item  is  produced  by 
the  same  company  at  different  plants, 
those  plants  have  different  PI  curves. 

It  is  important  to  recognize  that  different 
contractors  have  different  PI  curves  for 
different  items.  And  it  is  folly  to  apply  a  PI 
curve  universally  to  all  contractors  or  items 
being  manufactured.  Contractors  determine 
their  PI  curve(s)  by  collecting  and  evaluating 
cost  performance  data  on  individual  items  or 
products.  Contractors  therefore  generally  have 
a  set  of  PI  curves  for  different  products  which 
they  apply  when  preparing  proposals. 
Although  PI  curves  show  a  wide  variation  from 
contractor  to  contractor,  plant  to  plant,  and 
product  to  product,  they  arc  generally  bound 
between  the  75  and  100%  range. 

The  nature  of  work  and  type  of  manufacturing 
operations  being  performed  is  the  major 
determinant  of  the  slope  of  the  PI  curve. 

Performance  improvement  depends  on  people 
learning.  This  learning  is  predictable.  The 
more  complex  the  task  the  greater  the  rate  of 
learning  (man  paced  operations  are  open  to 
greater  rates  of  learning  than  machine  paced 
operations).  For  example,  consider  machining 
and  assembly.  If  the  machining  content  of  the 
product's  cost  is  a  higher  percentage  of  the 
item's  total  cost,  the  rate  of  learning  declines 
and  the  learning  curve  has  a  higher  percentage 
value.  Conversely,  the  greater  the  intensity  of 
hand  assembly,  the  lower  the  curve  percentage. 
That  is  to  say,  the  greater  the  hand  assembly 
content  of  the  operation,  the  greater  the  learning 
potential  which  yields  curves  with  lower 
percentage  slopes.  An  80%  slope  is  represen¬ 
tative  of  higher  performance  improvement  than 
a  90%  curve.  Practitioners  of  the  PI  curve 


have  used  the  PI  curve  within  the  following 
ranges  in  the  indicated  areas: 


Machining 

100  -  90% 

Fabricating,  machine 

95-80% 

Fabricating,  hand 

90  -  75% 

Hand  assembly 

90  -  60% 

Purchased  material 

100*80% 

Source:  Matthews,  Estimating  Manufacturing 
Costs — A  Practical  Guide  for  Managers  & 
Estimators 


There  is  no  consensus  of  finding  or  applica¬ 
tion.  As  general  guidelines  the  following  rep¬ 
resent  a  rough  estimate  of  performance 
improvement  curve  objectives. 


Raw  Material 

95% 

Purchased  parts 

95% 

Machining 

90% 

Fabricating,  machine 

90% 

Fabricating,  hand 

85% 

Assembly 

80% 

Direct  labor  (not  classified) 

87-1/2% 

Engineering 

90% 

Printed  circuit-board  assembly 

85% 

Source:  Matthews,  op  cit. 

For  situations  involving  a  mixture  of  human 
assembly  and  machine  processes,  the  following 
rates  are  often  used  as  baselines: 

75%  Assembly,  25%  Machine  =  80%  Curve 
50%  Assembly,  50%  Machine  =  85%  Curve 
25%  Assembly,  75%  Machine  =  90%  Curve 
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APPENDIX  II:  EXAMPLE  PPI 


APPENDIX  H.  RECOMMENDED 
PROPOSAL  PREPARATION 
INSTRUCTIONS 

(b)  PROPOSAL  PREPARATION 

INSTRUCTIONS 

0  MANPOWER  VOLUME 

(i)  The  instructions  for  this  volume  are 
written  to  accommodate  the  most  common 
estimating  procedures  and  requirements.  The 
Government  intends  to  accept  offeror's  format 
to  the  extent  that  it  meets  die  requirements  of 
this  volume.  However,  to  meet  our  specific 
needs  you  may  be  required  to  tailor  your 
existing  output  format.  All  negative  responses 
to  requirements  of  these  instructions  must  be 
clearly  identified. 

(ii)  You  must  submit  an  original  and 
four  (4)  copies  of  this  volume  to  the  address  set 
forth  in  block  seven  (7)  of  the  Standard  Form 
(SE)  33  and  provide  two  (2)  copies  each  to 
your  cognizant  administration  and  DCAA 
offices.  This  volume  shall  contain,  in  the 
format  requested,  all  estimates  needed  for  a 
complete  understanding  of  your  proposed 
manpower.  It  must  be  partitioned  into  the 
sections  specified  in  paragraph  (C)  below. 

(A)  General  Instructisns 

(a)  A  separate  manpower  sum¬ 
mary  shall  be  submitted  for  the  basic  contract 
effort  and  for  each  option  (if  any)  and  for  the 
total  contract  if  options  are  required.  All 
original  forms  will  be  included  in  the  same 
proposal  package  and  will  be  so  identified  on 
the  outside  cover. 

(b)  Additional  data  submitted  to 
the  contracting  officer  after  the  initial  proposal 
and  up  to  the  certification  date  shall  be 
completely  traceable  to  the  previous  proposal 
and  must  fiilly  explain  the  basis  for  the  change. 
A  summary  portraying  total  impact  must 
accompany  each  change  or  update. 

(c)  The  Manpower  Volume 
must  be  traceable  to  the  Cost  Volume. 
HOWEVER,  no  cost  or  pricing  data  shall  be 
presented  in  the  Manpower  Volume  except  that 
which  is  necessary  for  complete  understanding 


of  factored  labor.  All  cost  resulting  from  the 
manpower  shown  in  this  volume  must  be  easily 
identified  in  the  Cost  Volume. 

(d)  Organization  and  number¬ 
ing  within  the  Manpower  Volume  must  con¬ 
form  to  and  be  traceable  to  the  Cost  Volume. 
Labor  hours  and  supporting  infor-mation  must 
be  shown  at  the  fifth  level  of  the  PWBS  and 
must  be  summarized  to  the  next  higher  CWBS 
level.  The  level  one  summary  in  this  volume 
must  be  easily  traceable  to  the  Cost  Volume. 

(e)  The  instructions  for  this  vo¬ 
lume  are  written  with  the  assumption  that  all 
direct  labor  estimates,  including  factored  labor, 
are  determined  by  a  twelve  month  fiscal  year. 
Labor  estimates  shown  in  this  volume  must 
mirror  the  fiscal  periods  shown  in  the  Cost 
Volume,  Should  any  labor  factor  occur  more 
frequently  than  annually,  then  these  in¬ 
structions  will  be  interpreted  for  the  most  fre¬ 
quent  occurrence.  For  example,  if  the  of¬ 
feror’s  practice  is  to  discretely  estimate  direct 
labor  on  an  annual  basis  and  factor  a  particular 
labor  category  on  a  semi-annual  basis,  then  the 
proposal  must  be  presented  on  a  semi-annual 
basis. 

(B)  Computer  Aided  Edging 

The  preferred  method  for  sub¬ 
mitting  a  proposal  under  these  instructions  shall 
include  a  computerized  pricing  model  reflecting 
the  estimating  system  most  recently  approved 
for  use  on  government  contracts.  The  pricing 
model  used  shall  be  fully  annotated  to  permit 
full  understanding  and  use  by  the  government 
evaluators.  Both  the  model  and  input  must 
meet  the  following  minimum  requirements. 
The  proposal  values  shall  be  encoded  on  a  5 
1/4"  2S2D  diskette. 

(a)  Host  machine  — Zenith 
model  Z-248  (IBM  compatible)  with  operating 
capabilities  for  MS  DOS  3.0  or  higher. 

(b)  Host  Software  —  Lotus  1- 
2-3.  Release  2.01 

(c)  Required  pricing  model  out¬ 
put. 


n-i 


(1)  Summaries  to  be  pro¬ 
vided  in  Exhibits  1  through  8  formats. 

(2)  Changes  to  the  Man¬ 
power  Volume  must  result  in  an  automatic 
adjustment  to  the  Cost  Volume  summaries. 

(3)  Mid-point  of  effort  must 
be  an  automatic  calculation  though  not  ne¬ 
cessarily  embedded  in  the  summary  tables. 

(4)  Information  must  be 
easily  printed  in  Exhibits  1  through  8  format 

(d)  The  model  must  be 
structured  so  that  input  at  any  level  of  the 
model  will  result  in  an  appropriate  change  to 
the  affected  summary.  It  must  also  minimize 
the  amount  of  input  preparation  time.  It  must 
be  structured  such  that  it  provides  an  adequate 
vehicle  for  use  by  the  Air  Force  in  developing 
an  evaluation  position  and  for  comparing  the 
proposal  amounts  with  the  Air  Force  estimates. 

(e)  A  sufficient  amount  of 
documentation  must  be  provided  so  that  the 
model  can  be  easily  used  by  an  operator  with 
knowledge  and  experience  limited  to  the  Lotus 
1-2-3  system  commands. 

(C)  .tenizatifln  ofihsLManpowgr 

Volume 

The  following  paragraphs  de¬ 
scribe  the  minimum  information  required  to 
support  the  proposed  manpower.  They  also 
specify  the  section  in  which  the  information  is 
to  be  presented. 

(a)  Section  1.  Summary.  This 
section  will  contain  the  manpower  summaries 
at  the  level  which  they  will  be  represented  in 
the  Cost  Volume.  These  summaries  must  be 
presented  in  the  format  of  Exhibit  1  and  must 
contain  the  same  values  as  shown  in  the  Cost 
Volume.  The  following  instructions  apply  to 
the  data  requested  in  Exhibit  1  format. 

(1)  "Totals"  for  in-house 
labor  are  to  represent  a  summary  of  direct  labor 
hours  by  overhead  pool. 


(2)  "In-house"  labor  shall 
be  net  of  standard  pricing  factors  such  as  scrap, 
rework,  supervision,  distributed  labor,  etc. 

(3)  "Other"  labor  shall  in¬ 
clude  any  labor  generated  by  pricing  factors  or 
otherwise  not  resulting  from  discrete  estimates. 

(4)  Entries  in  the  PWBS 
columns  shall  be  directly  traceable  to  the 
Technical  Volume. 

(5)  Entires  in  the  ’TOTAL" 
column  are  row  totals  from  the  PWBS  columns 
and  shall  be  directly  traceable  to  the  Cost 
Volume. 

(6)  The  labor  categories  in¬ 
cluded  in  this  section  must  conform  to  your 
overhead  rate  structure. 

(b)  Section  ..2,  ..Labor-Ear 
penditure  Profiles.  The  offeror  shall  prepare 
labor  expenditure  profiles  in  the  formats  shown 
as  Exhibits  2  and  3.  Exhibit  2  is  an  array  of 
total  manpower  by  calendar  quarter  by 
overhead  pool/major  category.  The  "total" 
column  in  Exhibit  2  must  be  identical  to  the 
’TOTAL"  column  in  Exhibit  1.  Information 
presented  in  Exhibit  3  is  similar  to  that  in 
Exhibit  2  except  that  the  array  is  by  calendar 
quarter  by  task.  The  totals  shown  in  the 
’TOTAL"  column  in  Exhibit  3  must  be  identical 
to  the  column  totals  in  Exhibit  1. 

(c)  Section  3,..  Bases. oil  Es¬ 
timates  (BOE),  This  section  is  reserved  for  the 
offeror's  BOE.  Format  and  organization  of  the 
estimates  presented  in  this  sections  are  largely 
at  the  discretion  of  the  offeror.  There  are 
however,  some  basic  requirements  which  are 
mandatory.  These  are  as  follows. 

(1)  A  BOE  must  be  pro¬ 
vided  for  all  tasks  at  the  lowest  indenture 
required  by  instructions  for  the  Technical 
Volume. 

(2)  Each  indenture  will  con¬ 
stitute  a  subsection  and  will  be  separately 
tabbed  or  otherwise  segregated  from  the 
remaining  subsections. 
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(3)  Each  subsection  will 
contain,  either  on  the  tabbed  page  of  as  the  first 
page  of  theisubsection,  a  summary  of  the  labor 
hours  in  that  subsection.  11118  summary  must 
be  in  the  format  of  Exhibit  1.  A  summary  of 
the  lowest  indenture  will  contain  the  row  title 
column  and  a  ’TOTAL"column  only. 

(4)  Each  group  of  sub¬ 
sections  of  labor  falling  within  the  same  PWBS 
category  wdl  be  summarized  at  the  next  higher 
indenture.  The  summary,  in  Exhibit  1  format, 
will  show  each  task  it  is  summarizing  and  will 
provide  a  "TOTAL"  column  which  will  be  used 
in  the  next  higher  summary.  For  example, 
PWBS  task  3.1.7.9.2  wouldhave  an  Exhibit  1 
summary  with  only  the  "TOTAL"  column. 
PWBS  3.1.7.9  would  be  a  , summary  of  all 
PWBS  tasks  3.1.7.9.x  and  would,  in  Exhibit  1 
format,  provide  the  information  for  the 
individual  tasks  of  the  next  lower  indenture  and 
would  accumulate  all  3.1.7.x  "TOTAL" 
columns. 

(d)  Section  4.  Manufacturing 
Touch  Labor  fMIL-STD-1567A),  Estimated 
Direct  Manufacturing  (Touch)  Labor  using  the 
most  current  Engineered  Labor  Standards  in 
compliance  with  M1L-STD-1567A  and  these 
instructions.  As  a  minimum,  all  WBS  dements 
which  contain  touch  labor  shall  be  broken  out 
by  functional  category  (c.g.,  fabrication  and 
assembly,  functional  test,. etc.).  These  shall 
further  be  broken  out  by  Type  I  and  Type  II 
standards  (run  and  setup  time)  an:’  ran  quantity 
for  each  deliverable  unit  (see  exhibit  5).  The 
touch  labor  and  support  estimates  shall  also  be 
presented  in  accordance  with  Exhibits  6  and  7. 
The  contractor's  proposal  shall  also  provide  a 
breakout  of  the  Personnel,  Fatigue,  and  Delay 
(PF&D).  The  contractor  shall  identify  all 
unmeasured  touch  labor  efforts.  All  future 
improvements  which  impact  on  the  standard 
hours  (e.g.,  methods  improvement,  technical 
modifications,  automation,  5  year  capital 
investment  plan,  etc.). 

Realization  elements  applied  shall  also  be 
broken  out  (see  exhibit  5).  If  a  realization 
factor  is  estimated  by  mathematical  formula/ 
equation,  this  formula  must  be  fully  sub¬ 
stantiated  via  statistical  sampling  method  and 
regression  analysis.  Work  Measurement  re¬ 
alization  factors  used  to  modify  touch  labor 


hours  will  be  based  on  the  contractor’s  work 
measurement  performance  reporting  system. 
Any  other  modification  of  these  factors  for 
proposal  purposes  must  be  fully  supported. 

Performance  Improvement  curve  parameters 
used  to  developed  the  proposed  price  shall  be 
identified  and  rally  justified.  These  parameters 
shah  be  tabulated  in  accordance  with  exhibit  8. 
Management  goals  and  trend  analysis  for  each 
major  element  of  the  realization  factor  and 
standard  hour  content  of  deliverable  end  items 
shall  be  used  in  projecting  proposed  touch 
labor  hour's. 

Ah  work  measurement  systems  data  included 
and  used  in  support  of  the  offer  shall  be  audit 
verifiable  and  in  accordance  with  the  con¬ 
tractor’s  Cost  Accounting  Standards  Disclosure 
Statement.  The  government  shall  be  entitled  to 
complete  access  of  the  contractors  work 
measurement  system  including  any  associated 
data,  reports,  or  studies  used  by  the  contractor 
to  support  the  proposed  cost  The  terminology 
used  in  this  paragraph  is  defined  in  accordance 
with  MIL-STD-1567A,  Work  Measurement 

This  section  will  be  used  solely  to  explain  the 
derivation  of  the  labor  content  of  the  proposed 
price.  It  will  not  be  used  to  provide  in¬ 
formation  intended  to  be  included  in  the 
Technical  Volume.  Each  Volume  will  be 
evaluated  on  it’s  own  merits.  Information  in 
this  volume  will  not  be  used  in  evaluating  or 
understanding  the  Technical  volume  except  to 
the  extent  that  total  task  manpower  levels  will 
be  provided  to  the  Technical  Volume  evaluators 
as  required. 
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MANPOWER  SUMMARY 


TOTAL  LABOR 


LABOR  EXPENDITURE  PROFILE 


NOTE:  SPECIFY  MID-POINT  OF  EFFORT  FOR  EACH  TASK  SHOWN  ABOVE. 


CDRL  MANPOWER  SUMMARY 


1  2  3  4  5 


NOTE:  All  values  provided  must  be  substantiated  with  back-up  data 
*  Contractor  identified  elements,  subject  to  negotiation  between  the  contractor 
and  AFPRO/SPO 


MANPOWER  EXHIBIT  6 


MANUFACTURING  LABOR  SUMMARY 
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MANPOWER  EXHIBIT  7 


MANPOWER  EXHIBIT  8 
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APPENDIX  III:  EXAMPLE  RFI 


APPENDIX  m.  TYPICAL  REQUESTS  FOR 
INFORMATION 

The  information  required  to  evaluate  a  proposal 
is  often  dispersed  throughout  the  proposal  and 
as  a  result  very  difficult  to  isolate  and  extract, 
sort,  and  interpret.  When  this  situation  exists, 
the  proposal  may  be  rejected.  More  often 
however,  the  proposal  are  marginally  acceptable 
as  prepared  and  only  require  supplemental 
information.  In  these  situations,  clarifications 
and  supplemental  data  are  requested  from  the 
offeror.  For  minor  items  such  as  typos  and 
other  simple  questions  such  as  "how  did  you 
arrive  at  that  figure?",  the  most  expedient 
method  is  used.  This  is  most  usually  a 
telephone  call.  If  this  method  proves 
unsatisfactory  or  more  substantive  questions, 
discrepancies  and  omissions  need  to  be 
resolved,  formal  Requests  for  Information 
(RFIs)  are  used.  These  RFIs  are  to  be  used 
whenever  a  documented  formal  response  or 
contractor  position  is  required  for  a  clear 
understanding  of  his  proposal.  All  RFIs  should 
be  coordinated  and  reviewed  with  the 
responsible  BSD/AWM  project  officer  and  are 
transmitted  to  the  contractor  through  the 
Contracting  Officer.  Contractor  response  to 
RFIs  arc  mandatory. 

Two  kinds  of  RFIs  can  be  written:  generic  and 
specific.  Generic  RFIs  apply  to  a  category  or 
range  of  data  requiring  clarification  or 
amplification.  Specific  RFIs  apply  to  a  narrow 
or  singular  set  of  data.  Some  typical  generic 
RFIs  are  included  below.  These  typical  RFIs 
are  included  to  serve  only  as  a  an  example  of  the 
kinds  of  data  usually  inadequately  presented  in 
proposals.  These  typical  RFIs  may  be  tailored 
to  the  individual  needs  of  each  proposal.  RFIs 
should  be  submitted  immediately  during  the 
review  process  in  order  to  permit  the  contractor 
sufficient  time  to  respond. 

1.  Manufacturing  Hours  Sorted  by 
Functions.  One  of  the  fact  finding  needs  is  to 
analyze  the  offerer's  proposed  manufacturing 
hours  by  function.  If  the  proposal  is  not 
appropriately  laid  out  by  function,  the  following 
RFI  can  resolve  this  problem. 

"Provide  a  supplemental 

Manufacturing  Volume  with  each 

WBS  Task  sorted  under  the 


following  manufacturing  func¬ 
tions  with  reference  to  the 
original  proposal  volume  and 
page  number:" 

Manufacturing  Touch  Labor 

a.  Touch  Labor  - 
Fabrication  and 
Assembly 

b.  Touch  Labor  -  Test 

Manufacturing  Support  Labor 

a.  Shop  Supervision 

b.  Manufacturing/ 

Production  Management 

c.  Production  Control  and 
Planning  and 
Scheduling 

d .  Procurement/Material 

e .  Manufacturing 
Engineering 

f.  Industrial  Engineering 

g.  Test  Equipment  and 
Tooling  Maintenance 

Note:  This  type  of  RFI  may  be  inappropriate  if 
a  quick  response  is  required.  If  however,  this 
data  is  deemed  vital  to  a  comprehensive  fact 
finding,  it  should  be  requested. 
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2.  Manufacturing  Hours  Summary. 
BSD  has  guidelines  for  support  labor  functions 
as  a  percentage  of  touch  labor  developed  over 
the  years  which  is  representative  of  competitive, 
well  managed  aerospace  companies  doing 
business  with  BSD  over  the  past  twenty  years. 
A  sort  of  the  proposed  manufacturing  hours  by 
WBS  sorted  by  manufacturing  functions  is 
desirable  and  helpful  in  assessing 
reasonableness  of  the  proposed  effort 


"Provide  a  summary  table 
(similar  to  Table  III-l)  showing 
proposed  hours  by  WBS  element 
sorted  under  the  manufacturing 
functions  listed.  Provide  also 
the  corresponding  hours  for  each 
previous  production  buy  and 
show  these  as  a  percent  of  the 
touch  labor." 


TABLE  III -1 


MANUFACTURING  LABOR  SUMMARY 

MANUFACTURING 

FUNCTION 

PROPOSED  BUY 

PREVIOUS  BUY  A 

PREVIOUS  BUY  B  I 

HOURS 

PERCENT 

TOUCH 

LABOR 

dm 

PERCENT 

TOUCH 

LABOR 

■ 

mBSemI 

nn 

TOUCH  LABOR 

- 

* 

SHOP  SUPERVISION 

MFG7PRODUCTION  MGMT. 

. 

PROD.  CONTROL  &  PLANNING 

PROCUREMENT/MATERIALS 

MRa  ENGINEERING 

INDUST.  ENGINEERING 

TEST  EQUIP.  &  TOOL  MAINT. 

_ 

_ _ m _ 

■■■■ 

■BH 

■■■■■■ 

■■EM 

■mi 

■HH 
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3.  Manufacturing  Hours  by  Line  Items. 
A  further  breakdown  of  the  sorting  of  Table  D3- 
1  has  utility  in  evaluating  the  individual  support 
labor  categories. 


"Provide  a  further  breakdown  of 
the  sorting  in  Table  HI-1  with  a 
line  item,  line-by-line  sorting 
and  totaling  of  the  functional 
sorts  as  shown  in  Table  III-2  for 
each  of  the  labor  functions  and 
related  WBS  tasks." 


TABLE  HI- 2 


4.  Justification.  This  is  required  when  the 
contractor's  rationale  provides  inadequate, 
vague,  or  non-existent  justification  for  proposed 
hours.  Example  of  an  inadequate  justification: 
A  contractor  contends  —  "This  is  based  on  the 
hours  negotiated  in  the  last  proposal."  This  may 
sound  on  the  surface  to  be  a  reasonable  basis  for 
the  estimate.  However,  it  should  be  noted  that 
the  items  typically  "negotiated"  are  the  bottom 
line  numbers  which  are  then  reallocated  by  the 
contractor  and  usually  result  in  estimates 
differing  from  that  which  was  recommended  for 
that  particular  line  item  in  the  last  proposal. 


Where  justification  is  required,  the  following 
RFI  is  recommended: 

"Provide  detailed  rationale  and 
justification  for  proposed  WBS 
task  XX  and  each  associated 
labor  function." 


"Provide  detailed  rationale  and 
justification  for  each  proposed 
WBS  task  and  labor  function." 
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5.  Line  by  Line,  Item  by  Item 
Breakdown  of  Standard  Hours.  For 
assessment  of  whether  the  contractor  is 
technically  current  and  how  the  Standards 
compare  between  buys,  data  as  defined  by  Table 
m-3  is  requested.  This  table  provides  a  Hne-by- 
line,  item-by-item,  breakdown  of  the  Standard 
as  well  as  the  Totals,  and  shows  the  percent  of 
Type  T  Standards.  This  allows  an  analysis  of 
whether  the  offeror  is  technically  up-to-date  and 
employing  appropriate  production  approaches 
and  tooling.  It  also  permits  analysis  of  how  the 
Standards  compare  between  buys  by  providing 
historical  data.  If  large  changes  in  Standards, 
components,  and/or  assemblies  occur  between 
buys  it  also  provides  justification  for  requesting 
detailed  rationale  for  the  changes. 


"Provide  a  Table  (similar  to 
Table  III-3)  showing  major 
components  and  subassemblies, 
quantity  being  manufactured, 
corresponding  proposed  standard 
hours  with  percentage  of  Type  I 
Standard  Hours.  Also,  indicate 
component  quantities  and  total 
standard  hour  content  per 
deliverable  end  item.  Further, 
provide  the  same  data  for  each 
previous  Production  Buy  and 
applicable  Development  Units. 

1.  Provide  historical  data  for 
comparative  purposes. 

2.  Provide  detailed  rationale  and 
justification  for  large  changes  in 
standard  hours  between  buys." 


TABLE  ID-3 


MAJOR  COMPONENTS  AND  SUBASSEMBLIES  -  QUANTITY  AND  STANDARD  HOURS 


PROPOSED  BUY 

PREVIOUS  BUY  A 

PROPOSED  BUY  B  1 

COMPONENTS 

QUANTITY 

STD  HRS 

% 

QUANTITY 

STD  HRS 

%  ' 

QUANTITY 

E53 

rirai 

% 

AND 

NO./ 

SSj 

mo 

TOT/ 

E2= 

NO./ 

EES 

ka;l 

B30 

5E= 

E5E 

m 

E13 

csa 

SSS2I 

SUBASSEMBLIES 

DEL 

IHTTii 

i»!aMI 

i 

DEL 

UNIT 

DEL 

1 

E=3 

m 

tm 

DEL 

1 

m 

s 

s 

mm 

S 

m 

■i 

TOTAL 

_ 
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6.  Realization  Factor  Analysis.  When 
the  offerer’s  realization  factors  need  to  be 
examined,  the  following  RFI  requesting 
breakdown  of  the  realization  factor  variances  is 
used.  This  breakdown  provides  insight  on  how 
the  non-work  (variance)  breaks  down  into  the 
four  generally  accepted  categories.  For 
example,  rework  and  engineering  changes  are 
self  explanatory.  Operator  inefficiency  is 
caused  by  poor  performance  to  Standard  by  the 
operator.  Shop  inefficiency  is  really 
management  inefficiency  and  some  examples 
include  material  shortages,  faulty  and  broken 
tools,  and  defective  material.  The  percentage  of 
these  variances  varies  depending  on  the 
operation  and  maturity  of  the  program.  It  is 
advantageous  for  evaluations'  sake  to  include  all 
variances  in  these  four  major  categories.  Some 
other  variables  include,  yield  (scrap),  precision 
machining  and  assembly,  and  restrictions  in 
assembly. 

We  want  to  see  where  the  numbers  came  from 
(Actuals,  Departments,  Work  Centers,  etc.)  and 
how  they  were  anived  at.  Bottom  line  is  to 
properly  assess  the  variances  and  outline  what 
things  need  to  be  done  to  increase  efficiencies 
and  decrease  cost  to  the  government 


"To  properly  assess  the 
Realization  Factor  (RF)  used  in 
the  proposal,  explain  how  the 
variance  categories  contributed 
to  the  total  RF,  provide  a  listing 
of'  the  appropriate  variance 
categories,  by  percent,  for  each 
proposed  RF,  and  provide 
justification  for  the  proposed 
variance  values.  For  example: 


1.  STANDARD 

(INCLUDES  PF&D)  100.0% 

2.  REWORK  XX.X% 

3.  OPERATOR  INEFFICIENCY  XX.X% 

4.  SHOP  INEFFICIENCY  (MGMT)  XX.X% 

5.  ENGINEERING  CHANGES  XX.X% 

TOTAL  XXX.X%" 


7.  Improvement  Curve.  Justification  for 
the  performance  improvement  curve  used  in  the 
proposal  must  be  provided.  The  performance 
improvement  curve  is  a  function  of  the  kind  of 
work  or  type  of  manufacturing  being  per¬ 
formed.  Typically,  the  PI  curve  slope  is 
determined  in  this  manner:  For  labor  intensive 
operations,  such  as  electronic  and  general 
assembly,  where  there  are  no  process  controlled 
functions,  a  steep  slope  is  used  because  there  is 
significant  opportunities  for  improvement. 
Where  highly  automated  non-labor  intensive 
manufacturing  such  numerically  controlled 
machining  is  involved,  a  relatively  flat  slope  is 
used  because  there  are  little  opportunities  for 
improvement.  Generally,  the  typical  manu¬ 
facturing  effort  consists  of  a  mixture  of  labor 
and  non-labor  intensive  operations  and  a  slope 
somewhere  between  the  two  extremes  is  used. 

When  such  justification  is  not  provided,  the 
following  RFI  is  to  be  submitted. 

"Provide  detailed  rationale  and 
justification  for  the  proposed 
Performance  Improvement  Curve 
Slopes." 

8.  ■  Scrap  Allowance.  Scrap  is  often 
difficult  to  account  for  and  should  be  confronted 
directly.  It  can  be  applied  at  the  lowest  level 
component  and  then  again  accounted  for  at  each 
ascending  level.  Some  contractors  additionally 
include  it  in  their  realization  factor.  It  is 
necessary  to  know  the  contractor’s  scrap  rate 
(yield)  and  where  it  is  accounted  for  in  the 
proposal  in  order  to  evaluate  its  validity  and  to 
ascertain  that  no  redundancy  is  occuring. 

"Provide  detailed  rationale  and 
justification  for  proposed  scrap 
allowances  and  show  how  and 
where  they  are  included  in  the 
proposal." 


m-6 


9.  Support  Labor.  Support  labor  function  replacement  and  maintenance  is  more 

estimates  are  generally  made  as  a  percentage  of  discemable.  When  both  hours  and  dollars  are 

the  Touch  Labor.  The  ratio  of  support  to  touch  called-out,  ratios  to  touch  labor  and  initial  cost 

labor  varies  with  die  cumulative  quantity  of  the  can  be  developed,  assessed,  and  evaluated, 

production  build.  And  similar  to  touch  labor,  ■ 

support  labor  efficiency  improves  with  learning  "Provide  the  total  cost  of  tooling 

and  experience,  and  the  inclination  of  the  (original  and  replacement  cost) 

operation  to  improvement.  Where  the  to  be  used  on  the  present  Buy. 

cumulative  quantity  is  a  small,  support  labor  can  Provide  the  total  cost  in  dollars 

run  as  high  as  250%  of  the  touch  labor.  It  is  of  proposed  tool  maintenance  for 

therefore  imperative  that  the  rationale  used  to  both  material  and.  labor.  Provide 

develop  the  support  labor  estimate  be  evaluated  the  rationale/justification  for  the 

in  detail;  consequendy,  the  need  for  detailed  proposed  maintenance  dollars 

rationale  from  the  contractor  as  in  the  following  and  hours." 

RFI. 

"Provide  detailed  rationale  and 
justification  for  the  proposed 
hours  for  each  support  labor 
function.  Include  improvement 
factors/curves,  historical  cost 
data  and  relationships  to  touch 
labor." 

"For  those  hours  estimated  by  a 
relationship  to  touch  labor, 
provide  the  basis  and  percentage 
used,  standard  hour,  historical 
data  or  other  basis  to  support  the 
estimate.” 


10.  ManPower  Phasing.  Time  phased 
charts  yield  insight  on  the  manpower  ramp-up 
and  ramp-down  of  each  buy  and  when  plotted 
against  each  other  allow  a  man  loading 
evaluation  of  the  overlapping  buys.  Where 
overlapping  buys  are  programmed,  this  insight 
will  facilitate  assessment  of  the  realism  of  the 
proposed  support  labor  estimates. 


"Provide  Time  Phased  Man 
Loading  Plots  for  each  support 
manufacturing  function  for  all 
concurrent  programs  (e.g., 
Development/Follow  On, 
Production  Buy  A,  Production 
Buy  B,  etc.)" 


11.  Tooling.  Tooling  initially  purchased  for 
a  program  is  supplemented  and  maintained  as 
the  program  progresses.  The  cost  of  this  needs 
to  be  evaluated.  When  specific  tooling  is  calied- 
out,  its  use,  wearability,  and  need  for 
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APPENDIX  IV:  SUPPORT  LABOR  FACTORS 


1 .  DoD  5010.15.1-M,  Standardization  of 
Woik  Measurement,  September  1973 

2.  Hartmcycr,  Fred  C,  Cost  Estimating  Data 
Standards  for  Elecxonic  Manufacturing, 
Ronald,  New  York,  1964 

3.  Gallagher,  Paul  F.,  Parametric  Estimating 
for  Executives  and  Estimators, 

Van  Nostrand  Reinhold 
New  York,  1982 

4.  Wilson,  Frank  S.,  Manufacturing 
Planning  andEstimating  Handbook, 
McGraw-Hill,  New  York,  1963 

5.  Matisoff,  Bernard  S,,'Handbook  of 
Electronic  Manufacturing  Engineering, 
Van  Nostrand  Reinhold  Gabor  standards 
are  given  on  p  57-98),  New  York,  1978 
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